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^ ' Abstract. The synthesis of classical Computational Complexity Theory with Recursive Analy- 

sis provides a quantitative foundation to reliable numerics. Here the operators of maximization, 

■ integration, and solving ordinary differential equations are known to map (even high-order dif- 
ferentiable) polynomial-time computable functions to instances which are 'hard' for classical 
complexity classes MV, #V, and CH\ but, restricted to analytic functions, map polynomial-time 
computable ones to polynomial-time computable ones — non-uniformly! 

We investigate the uniform parameterized complexity of the above operators in the setting of 

■ Weihrauch's TTE and its second-order extension due to Kawamura&Cook (2010). That is, we 
explore which (both continuous and discrete, first and second order) information and parameters 
on some given / is sufficient to obtain similar data on Max / and J f; and within what running 

■ time, in terms of these parameters and the guaranteed output precision 2 _n . 
It turns out that Gevrey's hierarchy of functions climbing from analytic to smooth corresponds to 
the computational complexity of maximization growing from polytime to A/'P-hard. Proof tech- 
niques involve mainly the Theory of (discrete) Computation, Hard Analysis, and Information- 
Based Complexity. 
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1 Motivation and Introduction 

Numerical methods provide practical solutions to many, and particularly to very large, prob- 
lems arising for instance in Engineering. Nonlinear partial differential equations for instance 
are usually treated by discretizing the domain of the solution function space, i.e. approximat- 
ing the latter by a high but finite dimensional space. Due to the nonlinearity, sub-problems 
may involve (low-dimensional) numerical integration and maximization and are regularly han- 
dled by standard methods. For instance Newton Iterations locally converge quadratically to 
a root xq of /', that is, a candidate optimum. 

We thus record that numerical science has devised a variety of impressive methods working 
in practice very well — in terms of an intuitive conception of efficiency. A notion capturing 
this formally, on the other hand, is at the core of the Theory of Computation and has led to 
standard complexity classes like V, MV, UV, ffV , CH, and VSVACE: for discrete problems, 
that is, over sequences of bits encoding, say, integers or graphs |Papa94| . To quote from 
[BCSS981 §1.4]: 

The developments described in the previous section (and the next) have given a firm 
foundation to computer science as a subject in its own right. Use of the Turing ma- 
chines yields a unifying concept of the algorithm well formalized. [. . . J The situation 
in numerical analysis is quite the opposite. Algorithms are primarily a means to solve 
practical problems. There is not even a formal definition of algorithm in the subject. 
[. . . ] Thus we view numerical analysis as an eclectic subject with weak foundations; 
this certainly in no way denies its great achievements through the centuries. 

Recursive Analysis is the theory of computation over real numbers by rational approxi- 
mations up to prescribable absolute error 2~ n . Initiated by Alan Turing (in the very same 
work that introduced the machine now named after him |Turi37| ) it provides a computer 
scientific foundation to reliable numerics [AFL96] and computer- assisted proofs |Rump04 in 
unbounded precision; cmp, e.g., |KLRK98|BLWW04 JBr ( H)H| . 

Remark 1.1 Mainstream numerics is usually scrupulous about constant factor gains or losses 
(e.g. 5x) in running time. This generally means an implicit restriction to hardware supported 
calculations, that is, to double and in particular to fixed-precision arithmetic. 

a) Alternative approaches that, in order to approximate the result with double accuracy, 
use unbounded precision for intermediate calculations, therefore reside in a 'blind spot' - 
which Recursive Analysis may shed some light on [MiiKolO] . 

b) Inputs x are in classical numerics generally considered 'exact'; equivalently: both subtrac- 
tion and the Heaviside function regarded as computable. 

c) Outputs y, on the other hand, constitute mere approximations to the 'true' values f(x). In 
consequence, this notion of real computation necessarily lacks closure under composition 
|Yap04j p.325]. 



The latter is more than just a conceptual annoyance: the (approximate) result of one subrou- 
tine cannot in general be fed as argument to another in order to obtain a (provably always) 
correct algorithm, thus spoiling the modular approach to software development! 

Rooted in the Theory of Computation, Recursive Analysis on the other hand is closed under 
composition — and interested only in asymptotic algorithmic behaviour, that is, ignoring 
constant factors in running times. 
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Remark 1.2 Libraries based on this model of computation [MiillOl Lamb07] ; on calculations 
that suffice with double precision (and thus do not actually make use of the enhanced power) 
can generally be expected to run 20 to 200 times slower than a direct implementation. Even 
in this limited realm they are useful for fast numerical prototyping, that is, for a first quick- 
and-dirty coding of some new algorithmic approach to empirically explore its typical running 
time behaviour and stability properties. Indeed, 

i) accuracy issues are taken care of by the machine automatically 

ii) closure under composition allows for modularly combining subroutines 

Hi) chosen from, or contributing to, a variety of standard real functions and non- /linear op- 
erators. 

Their full power of course lies in computations involving intermediate or final results with 
unbounded guaranteed precision [Ret08b] . 

Recursive Analysis has over the last few decades evolved into a rich and flourishing theory 
with many classical results in real and complex analysis investigated for their computabil- 
ity. That includes, in addition to numbers, also 'higher-type' objects such as (continuous) 
functions, (closed and open) subsets, and operators thereon |Zieg04|Sch r07]: by fixing some 
suitable encoding of the arguments (real numbers, continuous functions, closed/open subsets) 
into infinite binary strings. More precisely the Type-2 Theory of Effectivity (TTE, cmp. Re- 
mark [L8] below) studies and compares such encodings (so-called representations) [WcihOOj: 
mostly qualitatively in the sense of which mappings they render computable and which not. 

Fact 1.3 Concerning complexity theory, Ker-I Ko and Harvey Friedman have constructed 
in |KoFr82j certain smooth (i.e. C°°) functions f,g : [0; 1] — > [0; 1] computable in time poly- 
nomial in the output precision n ( short: polytime ) and proved the following: 

a) The function Max(/) := ([0; 1] 3 t ^ max{/(x) : < x < t}) G C°°[0; 1] is again 
polytime iffV = MV holds; cmp. |Ko91} Theorem 3.7]. 

b) The function f g := ([0; 1] 3 t i— > J^g{x)dx) G C°°[0;1] is polytime for every polytime 
f G C[0; 1] iff V = #V; cmp. [Ko9l"l Theorem 5.33]. 

c) More recently, one of us succeeded in constructing a polytime Lipschitz-continuous func- 
tion h : [0; 1] x [—1; 1] — > [—1; 1] such that the unique solution u := dsolve(/i) : [0; 1] — > 
[—1; 1] to the ordinary differential equation 

u'(t) = h(t,u(t)), u(0) = (1) 

is again polytime iff V = VSVAC8 [KawalOj . 

d) Restricted to polytime right-hand sides h G C k , dsolve(/i) is again polytime iff V = CH 
[KORZ12] . 

Put differently: If numerical methods could indeed calculate maxima (or even integrals or 
solve ODEs) efficiently with prescribable error in the worst case, this would mean a positive 
answer to the first Millennium Prize Problem (and beyond); cmp. [Smal98]! The proof of 
Fact 11.3a ) will be recalled in Example 11.141 below. 

Remark 1.4 a) We consider here the real problems as operators O mapping functions f 
to functions ©(/), that is, depending on the upper end t of the interval [0; t] which the 
given f is to be maximized, integrated, or the ODE solved on. Fixing t := 1 amounts 
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to junctionals f i— > A(f) := 0(/)(l); and the worst-case complexity of the single real 
numbers \\f\\ = Max(/)(1) and Lf(x)dx for polytime f G C°°[0;1] corresponds to 
famous open questions concerning unary complexity classes V\, MV\, and ffV\ [Ko914 
Theorems 3.16+5.32]; recall Mahaney's Theorem, 
b) It has been conjectured |Sharl2j that the difficulty of optimizing some (smooth) function 
f : [0; 1] —7- [0; 1] may arise from it having many maxima; and indeed this is the case for 
the 'bad' function f according to Fact 1 1.3ia ). However a modification of the construction 
proving Ko!)l . Theorem 3.16] yields a polytime computable smooth f such that, for every 
x £ [0; 1], | [o-ac] stains its maximum in precisely one point while relating the complexity of 

the single real Max (/J (1) to the complexity class UV\ of unary decision problems accepted 
by a nondeterministic polytime Turing machine with at most one accepting computation 
for each input. Recall the Valiant- Vazirani Theorem and that the open question "P ^ 



UV V is equivalent to that of the existence of cryptographic one-way functions [Papa94 
Theorem 12.1]. 

Indeed, the numerics community seems little aware of these connections. And, as a matter 
of fact, such ignorance may almost have some justification: The above functions / and g and 
h, although satisfying strong regularity conditions, are 'artificial' in any intuitive sense and 
clearly do not arise in practical applications. This, on the other hand, raises 

Question 1.5 a) Which functions are the ones numerical practitioners regularly and im- 
plicitly allude to when claiming to be able to efficiently calculate their maximum, integral, 
and ODE solution? 

b) More formally, on which (classes J-^ of) functions do these operations become computable 
in polynomial time 0(n d ) for some (and, more precisely, for which) d = d(k) £ N? 

We admit that numerics as pursued in Engineering might not really need to answer this ques- 
tion but be happy as long as, say, MatLab readily solves those particular instances encountered 



everyday. Such a pragmatical approach seems indeed compatible for instance with the spirit 
of the NAG library: 

nag_opt_one_var_deriv(e04bbc) normally computes a sequence of x values which 
tend in the limit to a minimum of F(x) subject to the given bounds. 

Both Mathematics and (theoretical) Computer Science, however, do come with a tradition 
of explicitly stating prerequisites^ to theorems and specifying the domains and running-time 
bounds to (provably correct) algorithms, respectively: crucial for modularly combining known 
results/algorithms to obtain new ones; recall the end of Remark 11.11 In the case of real 
computation, finding such a specification for maximization and integration, say, amounts to 
answering Question ll.5b ). Moreover, the answer cannot include all polytime C fc ~functions for 
any k G N according to Fact 11.31 On the other hand, we record 



"Theoretical physicists, used to regularly invoking Schwarz's Theorem, discard the following 'counter- 
example' as artificial: 

/:(-l;l) 2 ^R, (x,y)»i ' V &f ) i x >v) * (°>°) 

\0 (*,!,) = (0,0) 

Mathematicians on the other hand point out that Schwarz's Theorem requires as a prerequisite the continuity 
of the second derivatives. 

^not unsimilar to Paracelsus' "He who heals is right" in medicine 
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Example 1.6 One important (but clearly too small) class J- of functions f : [— 1; 1] — > M ; 
for which Max/ ; J f, and dsolve(/) as well as derivatives fU) are known polytime when- 
ever f is, consists of the real analytic ones: those locally admitting power series expansions, 
cmp. [Ko9Tl p.208] and see |Mull87IMuMo93IMull95IBGPll| : equivalently |KrPa02l Propo- 
sition 1.2.12]: those satisfying, for some A,KeN, 

V|s| < 1, Vj'GN: \f U) (x)\ < A-K j -j\ . (2) 

Indeed, the following is the standard example of a smooth but non- analytic function: 

i r i n f exp( — 1/x) X > 

Based on V Hospital's rule it is easy to verify that h is continuous at xq = and differentiate 
arbitrarily often with hP'{Q) = 0, hence having Taylor expansion around xq disagree with h. 

Note that both Fact 11.31 and Example 11.61 are stated non-uniformly in the sense of ignoring 
how / is algorithmically transformed into, say, Max/. Consisting of lower complexity bounds, 
this makes Fact 11.31 particularly strong; whereas as upper bounds Example 11.61 merely asserts, 
whenever there exists some d € N and an algorithm A approximating / within time 0{m d ) 
up to error 2~ m , the existence of some e € N and an algorithm B approximating Max/ 
up to error 2 _n within time 0{n e ): both the dependence of B on A and that of e on d are 
ignored. Put differently, the proofs of Example 11.61 may and do implicitly make use of many 
integer parameters of / (such as numerator and denominator of starting points for Newton's 
Iteration converging to a root xq of /' of known multiplicity where / attains its maximum) 
since, nonuniformly, they constitute simply constants. Useful uniform (computability and) 
upper complexity bounds like in [BGPllj . on the other hand, fully specify 

i) which information on / is employed as input 

ii) which asymptotic running times are met in the worst case 

iii) in terms of which parameters (in addition to the output precision n). 

The present work extends the Type-2 Theory of Effectivity and Complexity [Wcih03] to such 
parameterized, uniform claims. We focus here on operators and upper complexity bounds, 
that is, fully specified provably correct algorithms. 

Let us illustrate the relevance of integer parameters, and its difference from integral advice 
|Ziegl2 , to real computation of (multivalued) functions: 



Example 1.7 a) On the entire real line, the exponential function and binary addition and 
multiplication are computable — but not within time bounded in terms of the output pre- 
cision n only: Because already the integral part of the argument x requires time reading 
and printing depending on (any integer upper bound k on) x —> ±oo. 

b) Restricted to real intervals [—k;k], on the other hand, exp : | is computable in time 
polynomial in 0{n + k), noting that |_exp(/c)J has binary length of order k ■ log A;. 
Similarly, binary addition and multiplication on [—k; k] x [—k; k] are computable in time 
polynomial in 0{n + log k). 

Here and in the sequel, abbreviate log(/c) := \\og 2 {k + 1)]. 

c) Given a real symmetric d x d-matrix A, finding (in a multivalued way) some eigenvector 
is uncomputable. 
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d) However when given, in addition to A, also the integer 1(A) := mmx^ a (A) U°§2 dimkernel(^4— 
Aid)J G {0, . . . , [1 + log 2 d\}, some eigenvector can be found computably and, 

e) given the integer L(A) := Cardcr(>l) 6 {1, . . . ,d}, even an entire basis of eigenvectors, 
i.e. the matrix can be diagonalized computably. 

The rest of this section recalls the state of the art on real complexity theory with its central 
notions and definitions. 



1.1 Computability and Complexity Theory of Real Numbers and Sequences 

A real number x is considered computable (that is an element of M. c ) if any (equivalently: all) 
of the following conditions hold [WeihOOl §4.1+Lemma 4.2.1]: 

al) The (or any) binary expansion b n £ {0, 1} of x = J2 n >-N °n2~ n is recursive. 

a2) A Turing machine can produce dyadic approximations to x up to prescribable error 2~ n , 

that is, compute an integer sequence a:Ff3fi4o„eZ (output encoded in binary) with 

\x - a n /2 n+l \ < 2~ n ; cmp. e.g. |Eige08[ Definition 3.35]. 
a3) A Turing machine can output rational sequences (c n ) and (e n ) with \x — c n \ < e n — > 0; 

cmp. e.g. |PERi89[ Definition 0.3]. 
a4) x admits a recursive signed digit expansion, that is a sequence s n £ {0, — l,+l} with 

x = J2n=-N S ™2 n • 

Moreover the above conditions are strictly stronger than the following 

a5) A Turing machine can output rational sequences (c' n ) with c' n —> x. 

In fact relaxing to (a5) is equivalent to permitting oracle access to the Halting problem [Ho99j! 
We also record that the equivalence among (a2) to (a4), but not to (al), holds even uniformly. 

Remark 1.8 TTE constitutes a convenient framework for naturally inducing, combining, 
and comparing encodings of general continuous universes X like R: 

a) Formally, a representation £ of X is a surjective partial mapping from Cantor space 
{0,1} W to X [WeihOOl §3]. 

b) And ^-computing some x means to output a £-name (out of possibly many) of x, that 
is, print onto some non-rewritable \ZiegO r l^ tape an infinite binary sequence a = (cr n ) n £ 
{0, 1} W with £(ct) = x. 

c) Representations £ of X and vofY canonically give rise to one, called £ x v, of X xY: A 
£ x v-name of (x,y) is an infinite binary sequence (<7o,tq,<7i,ti, . . .) where a constitutes 
a £-name of x and f an v-name of y. 

d) Similarly, a countable family of representations £j of Xj canonically induces the represen- 
tation Y\j S,j °f Ylj as follows: For a fixed computable bisection ( ■ , • ) : N x N — > N, 
^ = (°"fc) fc is a Y\j Cj-name of [X, %j iff ( a (n,j))n is a £j-name of Xj for every j. 

e) The representation binary o/N encodes integers in binary self- delimited with trailing zeros: 
binary(l b 1 b x ■ ■ ■ 1 b n W ) := £™=o bj2P . 

Representation unary o/N encodes integers in unary: unary(l n w ) := n. 

f) Note that the bijection bin : {0, 1}* — > Z with 

(1 w n -i ■ ■ ■ wiwo) H- wq + 2w± H h 2 n ~ 1 w n - 1 + 2 n , 

(0 w n -i ■ ■ ■ wiwo) ^l-(w + 2wi + --- + 2 n ' 1 w n ^ 1 + 2 n ) 

itself is technically not a representation - but useful as a building block. By abuse of name 
we denote its inverse also by bin. 
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Concerning real numbers, the equivalences between (al) to (a4) refer to computability. Not 
too surprisingly, they break up under the finer perspective of complexity; some notions even 
become useless [WeihOOl Example 7.2.1]. On the other hand, (a2) and (a4) do lead to uni- 
formly quadratic-time equivalent notions [WeihOCH Example 7.2.14]. Somehow arbitrarily, 
but in agreement with iRRAM's internal data representation, we focus on the following formal- 
ization in TTE: 

Definition 1.9 a) Call i£R computable in time t(n) if a Turing machine can, given n G N, 
produce within t{n) steps w G {0, 1}* with \x — bin(u>)/2 n+1 | < 2~ n . 

b) A pdy-name of x G M is (an infinite sequence of O's and l's encoding similarly to Re- 
mark [T7S\f ) a sequence a n G Z such that \x — a n /2 n+l \ < 2~ n holds. 

c) A -name of z G C consists of a p^y-name according to b) o/Re(z) and one oflm(z), 
both infinite sequences interleaved into a single (Remark 1 1.8b ). 

d) A sequence (xj) C M. is computable in time t(n,j) if a Turing machine can, given n,j G N, 
produce within t(n,j) steps some a G Z (in binary) with \xj — a/2 n+1 | < 2~ n . 

e) A p^ y -name of a real sequence (xj) is a sequence (aj) G Z, encoded into an infinite binary 
string as above, such that \xj — 0( n j)| < 2~ n . 

f) Here and in the sequel fix the Cantor pairing function (n, j) = n + (n + j) ■ (n + j + l)/2. 

Note that the running time bound in a) is expressed in terms of the output precision n; which 
corresponds to classical complexity theory based on input length by having the argument n 
encoded in unary. Indeed, the output a G Z will have length <9(n + log \x\) in Landau notation. 
Within a /9d y -name of x according to b), the 0(log |x| +n) digits of a n similarly start roughly 
at position n ■ (n + log \x\). Similarly, since (m,j) < 0(m 2 + j 2 ), the digits of a/ m j) start 
within a ^ y -name of (xj) at position n « (m 2 + j 2 ) • (m + maxj<j log \xi\). We also record that 
both the mapping (m,j) i-> {m,j) and its inverse are classically quadratic-time computable. 

1.2 Type-2 Computability and Complexity Theory: Functions 

Concerning a real function / : [0; 1] —> M, the following conditions are well-known equivalent 
and thus a reasonable notion of computability [Crze57j . |PERi891 §0.7], [WeihOOl §6.1], [Ko911 
§2.3], [LLMOll Definition 2.1.1]. 

bl) A Turing machine can output a sequence of (degrees and lists of coefficients of) univariate 
dyadic polynomials P n G B[X] such that Vn G N : ||/-P n || < 2 _n holds, where D := \J n B n 
and ll/H := max{|/(x)| : < x < 1}. 

b2) A Turing machine can, upon input of every /?d y -name of some x G [0; 1], output a Pdy - 
name of f{x). 

b3) There exists an oracle Turing machine JW' which, upon input of each n G N and for 
every (discrete function) oracle answering queries "m G N" with some a G O m +i such that 
\x — a\ < 2~ m , prints some b G O n +i with \ f(x) — b\ < 2~ n . 

In particular every (even relatively, i.e. oracle) computable / : [0; 1] — > K is necessarily 
continuous. This gives rise to two causes for noncomputability: a (classical) recursion theoretic 
and a topological one; cmp. FigureHb). More precisely, every / G C[0; 1] is computable relative 
so some appropriate oracle; cmp. [WeihOO, Theorem 3.2.11]. 

Remark 1.10 a) The above (equivalent) notions of computability are uniform in the sense 
that x is considered given as argument from which the value f{x) has to be produced. The 



Parameterized Uniform Complexity in Numerics 



7 



nonuniform relaxation asks of whether, for every x G [0; l]nM c , f(x) is again computable: 
possibly requiring separate algorithms to do so for each of the (countably many) x G 
[0; l]nl c . For instance the totally discontinuous Dirichlet function is trivially computable 
in this (thus too weak) sense. 

b) Defining computable functions also on non- computable arguments (as above) is known to 
avoid certain pathologies in the partial case [WeihOO, Example 9.6.5] while making no 
difference on well-behaved domains [WeihOO, Theorem 9.6.6]. 

c) For spaces X,Y with respective representations £,v, TTE defines a (^,v)-realizer of a 
(possibly partial and/or multivalued) function f :C X Y to be a partial mapping F :C 
{0, 1} W — > {0, 1}" such that, for every £-name a of every x G dom(/) ; r := F(a) is a 
v-name of some y G f(x). And f is called (£,v) -computable if it admits a computable 
(£,v)-realizer. Notion (b2) thus amounts to (pd y , Pdy)-computability. 

Concerning complexity, (b2) and (b3) have turned out as polytime equivalent but different 
from (bl); cf. |Ko914 §8.1] and [WeihOO [ Theorem 9.4.3]. So as opposed to discrete com- 
plexity theory, running time is not measured in terms of the input length (which is infinite 
anyway) but in terms of the output precision parameter n in (b3); and for (b2) in terms 
of the time until the n-th digit of the infinite binary output string appears: in both cases 
uniformly in (i.e. w.r.t. the worst-case over all) x G [0; 1]. Indeed the dependence on x can 
be removed by taking the maximum running time over [0; 1], a compact set [We ihOO [ The- 
orem 7.2.7]. On non-compact domains, on the other hand, the running time will in general 
admit no bound depending on the output precision n only; recall Example 11.7b ) and see 
[WeihOOl Exercise 7.2.10]. 

The qualitative topological condition of continuity is a prerequisite to computability of a 
function. Its quantitative refinement capturing sensitivity on the other hand corresponds to 
a lower bound on the complexity [Ko9H Theorem 2.19]: 

Fact 1.11 If f : [0; 1] — > M is computable in the sense of (b3) within time t{n), then the 
function /x : N B n \— > t(n + 2) G N constitutes a modulus of continuity to f in the sense that 
the following holds: 



In particular every polytime computable function necessarily has a polynomial modulus of 
continuity; and, conversely, each f : [0; 1] — > M satisfying Equation |3|) for polynomial /i is 
polytime computable relative to some oracle. 

The Time Hierarchy Theorem in classical complexity theory constructs a set E C N decid- 
able in exponential but not in polynomial time. Appropriately encoded, this in turn yields a 
real number y[E] of similar complexity [WeihOO, Lemma 7.2.9]; and the same holds for the 
constant function [0; I]3i4 y[E] [WeihOO [ Corollary 7.2.10]: computable within expo- 
nential but not in polynomial time. We remark that, again and as opposed to this recursion 
theoretic construction, also quantitative topological reasons lead to an (even explicitly given) 
function with such properties; cmp. Figure Hb): 

Example 1.12 The following function is computable in exponential time, but not in polyno- 
mial time — and oracles do not help: 



Vx, y G dom(/) : \x - y\ < => \f(x) - f{y)\ < 2 



ii 



(3) 



/ : (0;1] B x h-> l/ln(e/x) G (0; 1] 



/(0) = . 
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Proof. Note that monotone / is obviously computable on (0; 1], and continuous in 0; in fact 

effectively continuous but with exponential modulus of continuity. More precisely, f{2~ m ) = 
i 

1/(1 + m ■ In 2) < 2~ n 44> m > (2™ — l)/ln2. Therefore arguments x = 2~ m must be known 
from zero (i.e. and with precision at least m exponential in n) in order to assert the value 
f(x) different from /(0) = up to error 2~ n . □ 





RECURSION 
THEORETIC 


TOPOLOGICAL 


NON- 
COMPUTABLE 


f(x) = y[H] 


f(x) = sgn(x) 


EXPONENTIAL 
COMPLEXITY 


f(x) = y[E] 


f(x) = l/\n(e/x) 



Fig. 1. a) The graph of f(x) = l/ln(e/a;) from Example 11.121 demonstrating its exponential rise from 0. 

b) Lower bound techniques in real function computation; H C N is the Halting problem and EXP \V. 



Concerning computational complexity on spaces other than M, consider 

Definition 1.13 a) A partial function F :C {0, 1} W — > {0, 1} W is computable in time t : 
N — > N if a Type-2 Machine can, given a £ dom(F), produce f = F(a) such that the n-th 
symbol of f appears within t(n) steps. 

b) For representations £ of X and v of Y, a (possibly partial and multivalued) function 
f :C X Y is computable in time t : N — > N if it has a (£, v)-realizer F according to a). 

As already pointed out, this notion of complexity may be trivial for some £ and v. (Meta- 
) Conditions on the representations under consideration are devised in }Weih03] . We conclude 
this subsection by recalling the construction underlying |Ko91i Theorem 3.7] of a polytime 
computable smooth h : [0; 1] — > [0; 1] for which the function Max(/i) : [0; 1] — > [0; 1] is not 
polytime unless V = MV: 

Example 1.14 a) Recall from Example \1.6\ that the function 

hi{x) :=exp( i |§3 T ) for\x\<\, /ii(x):=0 for\x\>\ 

is smooth on [— 1; 1] and vanishes outside [ — Similarly, the scaled and shifted 

hjsf(x) := h(2N 2 ■ x — 2N)/N lnN is smooth with maximum exp(— In 2 N) attained at x = 
1/N and vanishes outside [jj — j^i] jj + j^p] ■ Note that — > + ^ny^rp holds 
for N £ N, hence h]y has support disjoint to that of h^' whenever JV,JV'gN are distinct. 
Moreover, for every j G No, h% \x) = h^\2N 2 ■ x — 2N)-N 2 i /N XnN — > uniformly in x as 
N — > oo. Therefore (and abusing notation) the function hi '■= Y1n&l '■ [0; 1] — >• [0; 1] is 
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M=0, 1, 2 M=0 M=\ m=0 



Fig. 2. Encoding decision problems into smooth functions: Illustrating the proof of Example 11.141 



smooth for every L C N; and the question "N £ L?" reduces to evaluating hi{l/N) up to 
absolute error 2~ n for n := (IniV) 2 -loge polynomial in the length of N: Modulo polytime, 
the computational complexity of hi coincides with that of L as a discrete binary decision 
problem. 

b) We argue that also the computational complexity o/Max(/i^) coincides (modulo polytime) 
with that of L. To this end note that, for x < 1, exp(x/2) < 1 + x and thus ln(l+x) > x/2: 

ln 2 (iV + l)ln 2 (iV) = (ln(iV + 1) + In(iV)) • In (l + i) > 2 In (i\T)/ (27V) > 1/N , 

e ~ln 2 (N) _ e -ln 2 (iV+l) = e ~ln 2 N . ^ _ g - ( ln 2 (iV+l)-ln 2 (iV)) ^ 

because 1 - e~ l / N > = e _lnAr_1 . Note observe that Max (h L )(l/N) = exp ( - ln 2 (iV)) 
holds if N £ L, whereas Max (h L )(l/N) < exp ( - ln 2 (iV + 1)) if N L. And the above 
estimates demonstrate that both cases can be distinguished by evaluating Max m^J (1/iV) 
up to absolute error 2~ n for n := 0(ln 2 N) polynomial in the binary length of N . 

c) Slightly more generally consider 

L C {(N,M) : N e N,N 3 M < N}, K := {N : 3M : (N, M) G L] 

and observe that the condition M < N on integer values implies the binary length of M 
to be bounded by that of N from which in turn follows M < 2N ; hence this condition 
can be met by 'padding' N with polynomially many dummy digits in order to obtain a 
MV ' -complete K with L G V . Now let 

h N , M (x) := h^N 3 -x-3N 2 - M)/N lnN , h L := £ h N , M 
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and note as in a) that h^,M is smooth with maximum exp(— In 2 N) attained at xn,m - z 



~k W 3 an d van ishes outside 

N 



N 



+ 



M-l/2. 1 . A/+1/2 



3iY 3 ' N 



+ 



3N3 



Moreover 



1 



> 



AT+1 



+ 



3(jv+i) a 6(jv+i) 3 shows that ftjv,M has support disjoint to that of fo/v',Af' f or distinct 
(N,M), (N',M r ) with M < N and M' < N'. Hence h L is polytime computable iff L €V. 
On the other hand it holds Max {Jil) (xn,n-i) = e x P ( — ln 2 (./V)) in case N £ K and 
Max (hi) (xjv,jv— l) < ex P ( — ln 2 (A r + 1)) m case N ET: 6oi/i distinguishable by evalu- 
ating {hL){xN,N-i) up to absolute error polynomial in the binary length of N. Therefore 
polytime evaluation o/Max(/i^) implies K G V = MV . 



1.3 Uniformly Computing Real Operators 

In common terminology, an operator maps functions to functions; and a functional maps (real) 
functions to (real) numbers. In order to define computability (Remark ll.lOb ) and complexity 
(Definition 11.13b ). it suffices to choose some representation of the function space to operate 
on: for integration and maximization that is the set C[0; 1] of continuous / : [0; 1] —> M. 
In view of Section \1.2\ (bl) provides a reasonable such encoding (which we choose to call 
[Pdy — > Pdy] ) : concerning computability, but not for the refined view of complexity. In fact any 
uniform complexity theory of real operators is faced with 

Problem 1.15 a) Even restricted to C([0; 1], [0; 1]), that is to continuous functions f : 
[0; 1] — > [0;1], the maps f : [0; 1] 9 x i— > f[x) £ [0; 1] are not computable within time 
uniformly bounded in terms on the output error 2~ n only. 

b) Restricted further to the subspace Lip 1 ([0; 1], [0; 1]) of non- expansive such functions (i.e. 
additionally satisfying \f(x) — f(y)\ < \x — y\), there is no representation (i.e. a surjection 
5 defined on some subset of {0, 1} U ) rendering evaluation or integration computable in 
uniform time subexponential in n. 




Proof, a) follows from Fact 11.111 since there exist arbitrarily 'steep' continuous functions 
/:[0;1]->[0;1]. 

b) Technically speaking, the so-called width of this function space is exponential |Weih03t 
Example 6.10]. More elementarily, Figure [3] demonstrates how to encode each b £ {0, l} n 
into a non-expansive function ft : [0; 1] — > [0; 1] with ||/r— /all ^ for b ^ a. These 2 2 ™ 
functions thus can be told apart by evaluation up to error 2~ n ~ 2 at arguments (k + 1/2) • 
2 _n , < k < 2 n ; alternatively by integrating from k • 2~ n to (k + 1) • 2~ n . Any algorithm 
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doing so within time < t(n) can read at most the first N := t(n) bits of its given <5-name. 
However there are only 2^ different initial segments of putative such names. It thus follows 

t(n)>2 n( - n \ □ 

|Ko91t Definition 2.37] solves Problem II. 15b , ) by permitting the running time to depend 
polynomially on both n and /'s modulus of continuity as a second (order) parameter, similar 
to Example 11.7b ). We provide an alternative perspective to this resolution in Subsection [2] 
below. 



1.4 Type-3 Complexity Theory 

Concerning Problem 11.15b ). encodings as strings with sequential access seem a restriction 
compared to actual computers random access memory and subroutine calls providing on- 
demand information: Given (an algorithm computing) some /, this permits to approximate 
the value f(a) for a G D n+ i up to error 2~ n without having to (calculate and) skip over all 
order 2 n values f(a'), a' E D n >, n' < n. This can be taken into account by modelling access 
to / via oracles that, given a G D n +i> report b £ O n +i with |6 — f(a)\ < 2~ n ; equivalently: 
using not infinite strings (i.e. total mappings {1}* — >• {0, l}) but string functions (i.e. total 
mappings {0, 1}* — > {0, 1}*) to encode /. And indeed [KaColO] resolves Problem 11.15b ) by 
extending TTE ( Remark II. 8 p and generalizing Cantor space as the domain of a representation 
to (a certain subset of) Baire space: 

Definition 1.16 a) Let TZ denote the set of all total functions ip : {0, 1}* — > {0, 1}* length- 
monotone in the sense of verifying 

\v\ < \w\ => \tp(v)\ < \tp(w)\ . (4) 

Write \ip\ : N — > N for the (thus well-defined) mapping \w\ h-> |^/>(u?)|. 

b) A second-order representation for a space X is a surjective partial mapping (:C?l-^X. 

c) Any ordinary representation £ :C {0, 1} W — > X induces a second-order representation £ as 
follows: Whenever a is a ^-name of x, then tp : {0, 1}* 3i)4 er^ 6 {0, 1} is a ^-name 
of said x. 

d) Let £ :C TZ — > X and v :C TZ — > Y be second-order representations. The product £ x v is 
the second-order representation whose names for (x,y) £ X xY consist of mappings 

Ow i — y m -W°Whip (w), i — y o m ~\^)\ l^(uJ) 

where ipo denote a £-name of x and tpi a v-name of y and m := m&x{\ipo(w)\, 1^1(^)1}- 

e) More generally, fix a injective linear-time bi-computable length-monotone mapping ( • , • ) : 
{0, 1}* x {0, 1}* — > {0, 1}* and an arbitrary index set A C {0, l}* as well as second-order 
representations £5 :C TZ — >■ X^, a £ A. The product HaeA^a ^ s the second-order represen- 
tation ofY\^ eA X^ whose names ip of (x^) SeA satisfy that {0, l}* B v 1— > ip((a, v}) £ {0, l}* 
constitutes a ^-name of x^ for each a £ A, padded with some initial 0* 1 to attain common 
length \ip\(n) on all arguments of length n = \ (a,v)\. 

f) An oracle Type-2 Machine J\A^ may write onto its query tape some w £ {0, l}* which, 
when entered the designated query state, will be replaced with v := ifj(w). 

(We implicitly employ some linear-time bicomputable self- delimited encoding on this tape 
such as (u>i, . . . , w n ) i->- 1 W\ 1 W2 ■ ■ ■ 1 w n 0.) 
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g) JvO computes a partial mapping F :C {0, 1} W x TZ — > {0, 1} W if, for every (a, ifi) G dom(F), 
Ai"^ on input a produces F(a,ip). 

jW' computes a partial mapping G :C {0, 1} W X TZ — > TZ if, for every (a, tp) G dom(G') and 
every v G {0, l}* ; on input (a,v), v G {0, l}* ; produces G{a,if)(v) G {0, 1}*; cmp. 
Figure \$p). 

h) For ordinary representation £ of X and second-order representation vofY and ordinary 
representation Q of Z , F :C {0, 1} W x TZ — > {0, 1} U is a (£,,v, Q-realizer of a (possibly 
partial and multivalued) function f :C X x Y z4 Z z/f, /or every (x,y) G dom(/) and 
every £-name a of x and every v-name of y, F(ip) is a C^-name of some z G f(x,y). 
For second-order representation £ of Z, G :C {0, 1} W x TZ —> TZ is a (£,£?, Q)-realizer of f 
if, for every (x,y) G dom(/) and every £-name a of x and every v-name of y, G(vp) is a 
Q-name of some z G f(x,y). 

From a mere computability point of view, each representation on Baire space is equivalent to 
one on Cantor space [WeihOOj Exercise 3.2.17]. Concerning complexity, an approximation 
of ifi G TZ up to error 2~ n naturally consists of the restriction V'l {o,i}"- } 5 cmp. |KaCo96l Def- 
inition 4.1]. Recall that any t/j : {0, l}* — > {0, l}* may w.l.o.g. be presumed self-delimiting 
and then redefined such as to satisfy Equation by appropriately 'padding'. We require 
every (-name ip to be total, but often the information on x is contained in some restriction 
of ip. Note that an oracle query w i— > v := ip{w) according to Definition I1.16f ) may return 
a (much) longer answer for some argument tp than for some other ip'; so in order to be able 
to even read such a reply for some fixed n, the permitted running time bound should involve 
both n and Since only the former is a number, this naturally involves a concept already 
introduced in [Mehl76j : 

Definition 1.17 a) A second-order polynomial P = P(n,£) is a term composed from vari- 
able symbol n, unary function symbol £(), binary function symbols + and x, and positive 
integer constants. 

b) Let T : N x N N — > N be arbitrary. Oracle machine M 7 computing F :C {0, 1} W x TZ — > 
{0, 1} W according to Definition \1.1 6f +a) operates in time T if, for every (d% t/0 G dom(i ? ) 
and every n G N, on input a produces the n-th output symbol within at most T(n, \i[>\) 
steps. 

M' computing G :C {0, 1} U x TZ — ^ TZ operates in time T if, for every (a,ip) G dom(G), 
on input v G {0, l} n makes at most T(n, steps. 

c) For ordinary representations £ of X and C, of Z as well as second-order representations 
v of Y and C, of Z , a (possibly partial and multivalued) function f :C X x Y ^ Z is 
{^,v,Q)- computable in time T iff f has a (^,v,C)-realizer F computable in this time; 
similarly for (£, v, £) -computability. 

d) Second-order polytime computability means computability in time P for some second-order 
polynomial P. 

e) An ordinary representation £ of X polytime reduces to an ordinary or second-order rep- 
resentation v of X (written £ ^ p £J if the identity id : X — ^ X is (^v) -computable within 
(first- order) polytime. 

A second-order representation £ of X (second- order) polytime reduces to an ordinary or 
second-order representation v of X (written £ :<p £,) if the identity id : X — > X is (£,v)- 
computable in second-order polytime. 

(Second-order) polytime equivalence means that also the converse(s) hold(s). 
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'Long' arguments t/j are thus granted more time to operate on; see Remark 11.201 b elow . Every 
ordinary (i.e. first-order) bivariate polynomial p(n, k) obviously can be seen as a second-order 
polynomial by identifying k 6 N with the constant function £(n) = k; but not conversely, as 
illustrated with the example n ■ £^n 5 + (£(n 2 )) 2 ^. Second-order polynomials also constitute 
the second-level of a Grzegorczyk Hierachy on functionals of finite type arising naturally as 
bounds in proof-mining [Kohl96, middle of p. 33]; cmp. also [?, §A] and [TeZilO| . In fact on 
arguments £ polynomial of unbounded degree, only second-order polynomials satisfy closure 
under both kinds of composition: 

(QoP)( n ,£) := Q(P(n,£),£) and (Q»P)(n,£) := Q(n,P(-,£)) . (5) 

Second-order representations induced by ordinary ones on the other hand basically use only 
string functions ip on unary arguments with binary values, i.e. of length \tp\ = 1; and these 
indeed recover first-order TTE complexity: 

Observation 1.18 a) Any bivariate ordinary polynomial p(n,m) can be bounded by some 
univariate polynomial in n + m. Any bivariate second-order polynomial P[n, £Q, A;Q) - 
that is a term composed from n, £(), k(), +, x, and 1 — can be bounded by some Q(n,£Q + 

*0). 

b) Let P = P(n,£) denote a second-order polynomial and£ a monic linear function with offset 
k, i.e., £(n) = n + k £ N. Then P(n,£) boils down to an ordinary bivariate polynomial in 
n and k. In particular, P(Q,= k) is a polynomial in k. 

c ) More generally, fix d £ N and consider the module of polynomials £ over N of degree 
less than d: £{n) = J2j<d^j n '' '• 

Subject to this restriction, every second-order polynomial P = P(n, £) can be bounded by 
a univariate polynomial in n + ko + • • • + kd-i- 

d) Let £ denote an ordinary representation of X and £ its induced second-order representa- 
tion. Then £ reduces to £ within (first-order) polytime: £ ^ p £; 

and £ reduces to £ within first-order polytime: £ £. 

e) Let £ and v denote ordinary representations of X and Y with induced second-order rep- 
resentations £ and v, respectively. Then the second-order representation (x« of X x Y 
induced by £ x v is polytime equivalent to £ x v. 

f) For each j G N let £j denote an ordinary representation of Xj and £^ its induced second- 
order representation. Then the second-order representation \\ - £j of Y\j Xj is polytime 
equivalent to Y\j £ tJ , that is, with respect to indices encoded in unary. 

Proof, a+b+c) are immediate. 

d) Given a and v, it is easy to return a^, thus (£, £)-computing idx within polynomial time; 
similarly for the converse, observing that (-names ip have constant length, see b). 

e) Observe that a £ x u-name ip of (x, y) has = 1 and £,(ip(l- 2n ) n ) = x and v(ip(l 2n+1 ) n ) = 
y; while a £ x -u-name ip has \tp\ = 1 and £(^(0 l n )„) = x an d v(ip(l l n ) n ) = y. 

f) A Y\j name of (xj) has \ip\ = 1 and )„) = x j] while a ( ]X ^jj-name V nas 
|V|^land£ i (^((l- ? ',l n )) n )=x i □ 

As with ordinary representations, not every choice of £ and v leads to a sensible notion of 
complexity. Concerning the case of continuous functions on Cantor space and on the real 
interval [0; 1], we record and report from [KaColOl §4.3]: 
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Example 1.19 a) Define a second-order representation p^ y :C B — > C[0; 1] as follows: 
Length-monotone ip : {0, 1}* — > {0, 1}* is a p^ y -name of bounded partial f :C [0; 1] — > M 

iff e {0,1}* : ( dom(/)n ball (bm(w)/2^ +1 , 2~W) ^0 =>• 

3x G dom(/)nball(bin(i(;)/2 N+1 ,2-^ 1 ) : | bin (V(^))/2^ l+1 - /(a:)| < 2 _w ) . 

/io/ds n + log H/lloo < l^l( n ) < Ci/> + n / or all n £ N and some G N. 
6; For £ > 0, Ze£ Lip £ [0; 1] := {/ : [0; 1] -»• K, - /(y)| < * • |x - y\} and Lip[0; 1] := 
IJ^Lip^O; 1] the class of (globally) Lipschitz- continuous functions. Define a (pj y +binary(Lip)) - 
name of f £ Lip[0;l] to be a mapping {0,1}* 3 w h-> (bin(^), tp(w)) G {0, l}* ; where 
ip denotes a p^ y -name of f and £ G N some Lipschitz constant to it. It thus holds 
n + log||/||oo + logl< M(n) <n+C ' r 

c) Define a [pdy— >Pdy] -name (in [KaColOj called a 5 n ~name) ip of f G C[0; 1] to be a mapping 
{0,1}* 9 w (->■ l^ 1 ™ 1 0t/;(-u;) £ {0,1}* , where ip denotes a p^ y -name of f and p :N 

is a modulus of uniform continuity to it. It thus holds p(n) + n + log ||/||oo < 1^1 ( n ) < 

d) Recall that the identity id is the standard representation of Cantor space. Inspired by 
[Roe slll Definition 3.6.1], consider the following second-order (multx\-) representation 
of the space UC(C {0, 1} U — > {0, 1} U ) of uniformly continuous partial functions on Cantor 
space: 

A fj-name of F maps l n 0x G {0, l}* to some l m 0y such that d(F(x),y) < 2~ n for all 
x G dom(F) with d(x,x) < 2~ m . Here d{x,y) = max{2~ : ' : Xj ^ yj V j > \y\} induces 
the the metric on Cantor space. 

e ) [Pdy— >Pdy\ is computably equivalent to [pdy— *Pdy]- 

More precisely the evaluation functional C[0; 1] x [0; 1] B (/, x) i— > f(x) G M. is ([pdy~ >Pdy] x 
Pdy, Pdy) -computable in second-order polytime; 

and the evaluation functional UC(C {0,1}^ -)■ {0,1}") x {0,1}" 3 (F,x) i-> G 
{0, 1} W is m x id, id) -computable in second-order polytime. 

f) It holds p\ + binary(Lip) < 2 V [pdpWdy] \ Up[ °'' 1] with Lip[0; 1] C C[0; 1]; 

but [p^ y ]| Lip[0i11 £\ p% + binary(Lip). 

g) For arbitrary closed K C {0, l}" , every total polytime- computable F : K — >■ {0, 1} W admits 
a polytime- computable fj-name ip. Similarly, to every 'family' of total functionals A : 
C[0; 1] x [0; 1] — > C[0; 1] ([pdy - ty?dy] x Pdy, Pd y ) -computable in second-order polytime, there 
exists a second-order polytime ( [pdy— >Pdy], [pdy-^Pdy]) -computable operator O : C[0; 1] — >• 
C[0; 1] such that A(f,x) = 0(f)(x) holds for all f and all x. 

Concerning a), each / G C[0; 1] is indeed bounded; hence the output of ip on {0, l} n can be 
padded with leading zeros (as opposed to Remark 1 1.8b ) to C(log ||/||oo) binary digits before 
the point and n after. On the other hand, p^ y alone lacks a bound on the slope of / necessary 
to evaluate it on non-dyadic arguments and leads to the representations in b) and c). 
Regarding d), note that the mapping l n 0x — > l m yields a local modulus of continuity to 
F; and the uniform continuity prerequisite again ensures that m = m(n,x) can be chosen to 
depend only on n and \x\, thus yielding a length- monotone string function ip. 



* Since we choose not to include a description of the functions' domains, a name of some F constitutes also 
one of every restriction of F. 
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In e), functions with 'large' modulus of continuity and/or 'large' values that might take 
'long' to evaluate (recall Example II . 12j) necessarily have [pay - ^Pdy] -names ip with 'large' \tp\. 
Explicitly on Cantor space, given x and re, invoke the oracle on l n and on finite initial segments 
x of x of increasing length m! = 1, 2, . . . until the reported l m y satisfies m < m', then print 
y: This asserts d[F(x),y) < 2 _n and takes poly(m, re) steps, that is, second-order polytime. 
The real case proceeds even more directly by querying oracle ip for m := jj,{n + 1) and then 
for f(q) with q G D m and \x — q\ < 2~ n ~ l . 

For the polytime reduction in f), verify that //(re) = re + log£ is a modulus of continuity to 
/ G Lip^[0;l]. Concerning failure of the converse, £ := 2 maXn M( n )-« could (if finite) serve a 
Lipschitz constant to / but is clearly not computable from finitely many queries to [i. We 
postpone the formal proof to Example I2.6h ). 

Turning to g), computing F in polytime means calculating the first re digits y of F(x) from x in 
time polynomial in re; and simulating this computation while keeping track of the number m of 
digits x of x thus read essentially yields the ij-name ip. The difficulty consists in algorithmically 
finding some appropriate padding to obtain ip length-monotone in the sense of Equation @ . 
For co-r.e. K, such a bound is at least computable [Weih03, Theorem 5.5]; however in our 
non-uniform polytime setting, it constitutes some fixed polynomial and can be stored in the 
algorithm. For fixed /, the real case proceeds similarly and is easily seen to run in second-order 
polytime uniformly in /. 

Remark 1.20 a) We follow [Mehl76 KaCo96 KaColO] in defining the complexity of opera- 
tors such that computations on 'long' arguments are granted more running time and still 
be considered polynomial, thus avoiding Problem \1.15h ). This approach resembles [LLMOll 
Definition 2.1.7] where, too, computations on 'long' arguments are granted more time to 
achieve a desired output precision of2~ n ; cmp. [Weih03, §7]. Note, however, that [L LMOli 
Definition 2.2.9] refers only to sequences of functions (cmp. Definition \1.16ti ) and, in 
spite of [LLMOTl Theoreme 5.2.13], is therefore not a fully uniform notion of complexity 
for operators. A related concept, hereditarily polynomial bounded analysis [Kohl98. Oliv05] 
permits polynomially bounded quantification and thus climbing up Stockmeyer 's poly- 
nomial hierarchy. 

b) Some f G Lip-JO; 1] can be regarded 

i) on the one hand as a transformation on real numbers and 

ii) on the other hand as a point in a separable metric space. 

Both views induce 'natural' notions of computability and complexity (Definition \1.13\) . Now 
i) and ii) are equivalent concerning the former |WeihOO} §6.1]; and so are they when equip- 
ping Lip-JO;!] with the second-order representation p^ y ; cmp. Lemma 4-9 in the journal 
version of [KaColO) . Indeed it seems desirable that type conversion ( the utm and smn prop- 
erties) be not just computable [WeihOO, Theorem 2.3.5] but within uniform polytime so 
( Example \l.l9e +f) — and, in view of Remark M .10b ). not merely for polytime- computable 
functions |Ko91} Theorem 8.13]. 

2 Parameterized Type-2 and Type-3 Complexity 

As illustrated in Example ll,7a +b). real number computations sometimes may not admit 
running times bounded in terms of the output precision only; cmp. also the case of inversion 
(0; 1] 3 x i-)- \jx [WeihOO \ Exercise 7.2.10+Theorem 7.3.12] and of polynomial root 
finding [Hotz09j. Such effects are ubiquitous in numerics and captured quantitatively for 
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instance in so-called condition numbers k of matrices or, more generally, of partial functions 
/ :C M. d — y R with singularities/diverging behaviour on 5; dom(/) |Biirg08|: in order to 
express and bound in terms of both n and k the number of iterations, i.e. basically the 
running time it takes in order to attain a prescribed (although, pertaining to the BSS model 
with equality decidable, usually relative) precision 2~ n . Put differently, k serves in addition to 
n as a second (but still first-order) parameter: just like in classical complexity theory [FlGr06]. 
We combine both TTE complexity [Weih03, Definition 2.1] and the discrete notion of fpt- 
reduction: 



Definition 2.1 a) Fix F :C {0, 1} W -> {0,1}^ and k : dom(F) -> N, called parameteri- 
zation of F . The pair (F, k) is fixed-parameter tractable if there exists some recursive 
function p : N — >• N such that a Type-2 Machine can compute dom(i ? ) 3 a i— > F(a) within 
at most ■ p(k(a)) steps. 

b) (F,k) is fully polytime computable if the above running time is bounded by a polynomial 
in both n and k{a), that is, if p G N[K]. 

c) A parameterized representation or representation with parameter of a space X is a tuple 
(£, k) where £ denotes a representation of X and k : dom(£) — > N some function. 

d) For a parameterized representation (£, k) of X and one (v,£) ofY, let (£, k) x {v ,£) := (£ x 
v,k+£) denote the parameterized representation ofXxY. Here, £xv is the representation 
according to Remark [ 1.81c ): and k + I formally denotes the mapping (<7 , To, o~i, n, . . .) h- > 
k{a Q ,ai,...) +£(t ,ti,...). 

e) For a parameterized representation (£, k) of X and a representation v of Y , a (possibly 
partial and multivalued) function f :C X Y is fully polytime ((£,k),v) -computable if 
it admits a (£ t ,v)-realizer F such that (F,k) is fully polytime computable. 

f) If in e) the representation v for Y is equipped with a parameter i as well, call f :C 
X =4 Y a fixed-parameter reduction if it admits a (t;,v)-realizer F such that (F,k) is 
fixed-parameter tractable and it holds £(F(a)) < k(a). 

g) Again for parameterized representations (£,k) of X and (v,£) of Y , a fully polytime 
((£, k), (v,£)) -computable f :C X Y must admit a (£,v)-realizer F such that (F,k) is 
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fully polytime computable while increasing the parameter at most polynomially: loF < pok 
for some p £ N[K] . 

h) A parameterized representation (£, fc) of X is fully polytime reducible to another parame- 
terized representation (v,£) of X (written (£, k) < p (v,£)) if id : X ^ X is fully polytime 
((£,£;), {v,€j) -computable. Fully polytime equivalence means that also the converse holds. 

Since the same point x £ X may have several £-names (some perhaps more difficult to parse or 
process than others) , also the parameter may have different values for these names in e+f+g) . 
Note that both fixed-parameter reductions (Definition 12. IF ) and fully polytime computable 
functions (Definition 12. lg ) are closed under composition. 

We did not define parameterized running times for second-order maps F :C TZ — >■ TZ: 
because TZ, as opposed to infinite binary strings, already comes equipped with a notion of size 
as parameter entering in running time bounds: recall Definition 11.17b ). 

Remark 2.2 The above notions make also sense for other complexity classes such as poly- 
nomial space. Giving up closure under composition, Definitions \2. lh +b+e+f) can be refined 
quantitatively to, say, quadratic-time computability — but Definition \2. l]g ) becomes ambigu- 
ous: just like in both the discrete case and [LLMOll Definition 2.1.7]; cmp. [Wcih03, §7]. 

Also, as in unparameterized TTE complexity theory, the above notion of (parameterized) 
complexity may be meaningless for some representations — that can be avoided by imposing 
additional (meta-) conditions [Wcih03, §4+§6]. Example 11.7b ) is now rephrased as Item a) 
of the following 

Example 2.3 a) The exponential function on the entire real line is fully polytime ({pdy, | Pdy I ) 5 Pdy) ~ 
computable, where \pd y \ '■= | • | ° Pdy! recall Definition \1.9l 

b) A constant parameter has no effect asymptotically: For any fixed c, polytime (£, v) -computability 
is equivalent to fully polytime ((£, c), v ) -computability and to fully polytime ((£, c), (v, £)) - 
computability. 

On the other hand, and as opposed to the discrete case, not every (even total) computable 
F : {0, 1} U — > {0, 1} W admits some parameterization k rendering (F,k) is fixed-parameter 
tractable. 

c) Suppose F :C TZ — )■ TZ is second-order polytime computable and has dom(i ? ) consisting 
only of string functions of linear length in the following sense: there exists c G N and 
k : dom(F) — > N such that every ip E dom(i ? ) satisfies Vn : 1^1 ( n ) < c • n + k(ip). Then F 
is fully polytime computable. 

The hypothesis is for instance satisfied for any (/)j y + binary (Lip), £>) -realizer F of some 
A :C Lip[0; 1] ^ Y. 

d) Evaluation of a given power series {(o J j) j , z) h-> Y^f=o a j z ^ ^ s n °t ((Pdy)^' Pdy) -computable, 
even restricted to real arguments \x\ < 1 and real coefficient sequences (aj)^ =: a of radius 
of convergence R(a) := 1/limsupj | o,^ | 1 > 1. 

However when given, in addition to approximations to a and z, also integers K, A with 

R > y/2 =: r and Vj : \aj\ < A/r j , (6) 

evaluation up to error 2~ n becomes uniformly computable within time polynomial in n, K , 
and log A. 

Formally let it denote the following representation of Cf := {a C C,R(a) > l}; A -k- 
name of a is a {{p\ y ) u X binary x unary ) -name (recall Definition \1.9\e +Remark [L8\c -l-d) 
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of (a, A, K) satisfying Equation (0|). Equipping it with parameterization K + \ogA renders 
evaluation (Cf, [— 1;1]) 3 {a,x) \-> Ylj a j x '' fully polytime ((7r, K + log A) x Pd y ,Pdy)~ 
computable. 

Note that the (questionable) fully polytime comput ability of exp(x) in a) hinges on using as 
parameter the value rather than, perhaps more naturally, the binary length of (the integral 
part of) the argument x. Indeed, similarly to the discrete function N 3 x \— > 2 X , an output 
having length exponential in that of the input otherwise prohibits polytime comput ability. 
A notion of parameterized complexity taking into account the output size is suggested in 
Definition I2.4j ) below. 

Proof (Example PO)) . 

a) immediate. 

b) A polynomial evaluated on a constant argument is again a constant. 

On the other hand the Time Hierarchy Theorem yields a binary sequence N 3 n \— > r n G 
{0, 1} computable but not within time polynomial in n; now consider the constant function 
F : {0, f. 

c) According to Observation ll.l8"k +b+c) , second-order polynomials P(n, £) on linearly bounded 
second-order arguments £(n) < c-n + k with fixed c can be bounded by an ordinary poly- 
nomial in n + k. 

Moreover recall (Example II . 19b ) that ( Pdy + bin ary (Lip)) -names have linear length. 

d) The negative claim is folklore; cmp. e.g. [MiiU95] . We defer the proof of the positive claim 
to Theorem E3Ji). □ 

Note that, for a parameterized representation of X according to Definition 12. Id ), a 

Type-2 Machine ((£, k), v) -computing some / : X 3 x t- > f(x) G Y is provided merely 
with a £-name a of x but not with the value k(a) of the parameter entering in the running 
time bound it is to obey. In the case of the global exponential function (Example 12.3a ). an 
upper bound to this value is readily available as part of the given pdy -name of x. In the case 
of power series evaluation (Example 12.3d ). on the other hand, the values of parameters K 
and A had to be explicitly provided by means of the newly designed representation tt, that 
is by 'enriching' |KrMa82"| p. 238/239] (p|y)^ '> m or der to render an otherwise discontinuous 
operation computable; recall also Example 11.71 Such simultaneous use of integers as both 
complexity parameters and discrete advice will arise frequently in the sequel and is worth a 
generic 

Definition 2.4 a) Let £ denote an ordinary representation of X and L : X N some total 
multivalued function. Then with advice parameter L in unary" means the following 
parameterized representation of X, denoted as £ + unary (L) =: (v,k): an v-name of 
x G X is an infinite binary string a = 1^ Of where f is a I; -name of X and i 6 L(x); and 
k(a):=£. 

b) Let £ denote an ordinary representation of X and L : X N some total multivalued 
function. Then "£ with advice parameter L in binary" means the following parameterized 
representation of X, denoted as £ + binary (L) =: (v, k): an v-name of x G X is an infinite 
binary string a = (bin(^),f) where f is a ^-name of X and I G L(x); and k(a) := logi. 
Here, ( • , • ) : {0, 1}* x {0, 1} W — > {0, 1} U denotes some fixed injective linear-time bi- 
computable mapping. 
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c) Let £ :C 1Z — > X denote a second-order representation and L : X N some total 
multivalued function. Then "£ with advice parameter L in unary" means the following 
second-order representation, denoted as £ + unary(L): a name of x G X is a mapping 
{0, 1}* 3i?4l'0 ^(mT) G {0, 1}* where ip is a l~name of x and £ G L(£(V>)) • 
Lei f :C K -> X denote a second-order representation and L : X N. Then "£ with 
advice parameter L in binary" means the following second-order representation, denoted 
as £ + binary(L): a name of x G X is a mapping {0, l}* 3 w \— > (bm(£),2p(w)) G {0, 1}* 
where ip is a £-name of x and £ G L(£(i/>)) . 

For a function F :C {0, 1} W x 7£ — >• {0,1}^ mi/i parameterization fc : dom(F) — > N, 
i/ie pair (F, k) is fully polytime if some oracle machine Ai~ can compute F according to 
Definition \1.17p ) within time a second-order polynomial in n + k and \ip\; 
similarly for functions G :C {0, 1} W x 7Z —> 1Z with parameterization k : dom(G) — > N. 

f) For a parameterized representation (£, k) of X and second-order representation v of Y 
and ordinary representation ( of Z, call f :C X x Y =4 Z fully polytime ((£, k),v,Q- 
computable if it admits a (£, v, Q-realizer F such that (F, k) is fully polytime in the sense 
ofe). 

If is a parameterized representation of Z , call f fully polytime ((£, k), v, ((,£)) - 

computable if in addition £ is bounded by a second-order polynomial P in k and 
l{F(a^)) <P(fc((7),M). 

If Z is a second-order representation of Z , call f fully polytime ((£, k), v, Q -computable 
if it admits a (£, v, Q-realizer G such that (G, k) is fully polytime in the sense of e). 

g) Fully polytime reduction of a parameterized representation (£, k) of X to a second-order 
representation £ of X is written as (£, k) ^ p £ and means fully polytime ((£, k),Q~ 
computability of 'id: X — > X; similarly for £ (£, k). 

h) (F,k) and (G,k) as in e) are fixed-parameter tractable if the computation time is < 
P(n, ■ p(k) for a second-order polynomial P and some arbitrary function p : N — )■ N. 
In the setting off), call f :C X x Y ^ Z fixed-parameter ((£, k), v, £) -computable if it 
admits a (£, v, Qj-realizer F such that (F, k) is fixed-parameter tractable; 

and fixed-parameter ((£,&),#,£) -computable if it admits a (£, v, Q-realizer G such that 
(G, k) is fixed-parameter tractable, 
j) For a parameterized representation (£, k) of X and second-order representation v of Y 
and a parameterized representation (£, £) of Z, call f :C X x Y =4 Z output-sensitive 
polytime [(xi, k),v, (£, £)) -computable if it admits a ((xi, k),v, (£, £)) -realizer computable 
within time a second-order polynomial in n + k + £ and the length of the given v-name. 
For second-order representation £ of Z, call f :C X x Y ^ Z output-sensitive polytime 
((xi,k),v,Q -computable if it admits a ((xi,k),v,Q -realizer computable within time a 
second-order polynomial in n + k + £ and the lengths of the given v -names and of the 
produced Q-names; recall Observation \l.lS\a ). 

A more relaxed notion of second-order fixed-parameter tractability (Item h) might allow 
for running times polynomial in n multiplied with some arbitrary second-order function of 
both k and Output-sensitive running times (Item j) are common, e.g., in Computational 
Geometry. As usual, careless choices of the output parameter £ or output representation £ 
may lead to useless notions of output-sensitive polytime computations. 

The representation of Lip [0; I] from Example lI.19b ) is an instance of Definition l2.4d ). Further 
applications will appear in Definition 13.11 below to succinctly rephrase the parameterized 
representation of Cf from Example 12.3d ). Items e)+f) extend Definition I2.1e +g+h). 
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Lemma 2.5 a) Fixing d G N and first- order representations £,v of X,Y, a total f : X 

is (xi,v) -computable with d-wise advice in the sense of |Ziegl2"| Definition 8] iff there 
exists some L : X ^ {1, . . . ,d} such that f is (£ + unary (L), v) -computable. 

b) £ + unary(L) and £ + binary(2 L ) are fully polytime equivalent; 

£ + unary(L) and £ + binary (2 L ) are second- order polytime equivalent. 

c) Extending Observation \l.l3d +e). let £ denote a representation of X with induced second- 
order representation £ and fix K : X ^N. Then it holds £ + binary(i\~) ^ p £ + binary(i\~) 
and £ + binary(i^) :<p £ + binary(.fr). 

Proof, a) immediate. 

b) It is easy to decode a given ((£, K) +unary(L))-name <r = l l f into ^ and f and to recode 
it into (bin(2^),r) as well as back, both within time 0(n + £); similarly for computing 
{0,1}* 3 (bin(2 £ ),V(w)) G {0,1}* by querying {0,1}* 3 w H- 1 £ , 0^(w)) G {0,1}*. 
and vice versa. 

c) Recall that a (£ + binary(i\"))-name of x is an infinite string of the form (b'm(k), a) with 
£(<r) = x and /c G K(x). It corresponds to a (£ + binary (if)) -name ip : l n t- > (bm(k), a n >) 
where n ~ n' + log/c and |^| ~ 1 + logfc has length independent of n. This leads to 
conversion in both directions, computable within time polynomial in n + log k. □ 

Without discrete advice, maximization remains computable but not within second-order poly- 
time even on analytic functions: 

Example 2.6 a) Evaluation (i) on Lip[0; 1], that is the mapping (f,x) i— > f(x), is uniformly 
polytime (p" y + binary (Lip), p dy , p dy ) -computable; 

addition (ii), and multiplication (Hi) on Lip[0; 1] are uniformly polytime (p^ y +binary(Lip), p^ y + 
binary(Lip)) -computable within second-order polytime 

b) and so is composition (vii) when defined, that is, the partial operator 

Lip[0;l] xLip([0;l],[0;l]) B(g,f)^gof£ Lip[0; 1] . 

c) Differentiation (iv) is {[p& Y —> p& y ], [pdy — > P&y\) -discontinuous (and hence 
0°dy + binary (Lip), p^ y + binary(Lip)) -uncomputable) even restricted to C°°[0; 1]. 

d) On the other hand differentiation does become computable when given, in addition to 
approximations to f G C 2 [0; 1], an (integer) upper bound on ||/"||oo- 

More precis ely, d : C 2 [0; 1] C x [0; 1] is polytime ((p|° ) y +binary(Lip)) / , p^ y +binary(Lip)) - 
computable, where a (pJJ y + binary (Lip)) ' -name of f G C 2 [0; 1] is defined to be a (pf y + 
binary(Lip)) -name of f G C x [0; 1]. 

e) Parametric maximization (vi), namely the operator 

MAX : Lip[0; 1] x [0; l] 2 3 (/, u,v) i — y max {f(x) : min(-u, v) < x < max(-u, v )}, (7) 

is (p^ y + binary (Lip), p\ y , p dy ) -computable, 

f) but not within subexponential time, even restricted to analytic real 1-Lipschitz functions 
/:[0;1]->[0;1]. 

g) Similarly for parametric integration (v), that is the operator 



fmax(u,ii) 

: C w (ball(0,l)) x [0;1] 2 3 (f,u,v) i-> / f(x)dx G M 

■/ min(u,u) 



(8) 
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Fig. 5. a) Gaussian functions qk and b) their shifts gx,k as employed in the proof of Example 12. 6F ). 
h) It holds [pdP^fdy]\ LiP ^'^ ii Pd y + binary (Lip). 

Proof. Concerning ai) and b) recall Example II . 19e +f ) ; aii) and aiii) follow immediately from 
the uniform pointwise polytime computability of addition and multiplication on single reals 
(Example 11.7b ). taking into account that the parameterized time-dependence of the latter 
for large arguments is covered in second-order polytime by the length of a name of /. The 
proof of [WcihOO, Theorem 6.4.3] also establishes c); for d) refer for instance to the proof 
of |Ko914 Theorem 6.2] or [WeihOCH Theorem 6.4.7]. Claim e) and the first part of g) is 
established, e.g., in [WeihOCH Corollary 6.2.5+Theorem 6.4.1]. 
For f) consider the family of analytic Gaussian functions 

gi {x) :=exp(-x 2 ), g K (x):= gi (K-x)/K = exp{-K 2 x 2 )/K, K £ N 

depicted in Figure [5^). For K S> 1 these are 'high' and 'thin' but not too 'steep' in the 
sense that Vx : |<fc(x)| < 1, that is, 1-Lipschitz and thus admit a linear-size -name ip; 
similarly for their shifts gx,k : [0; 1] 9 i >4 gx(x — k/K), < k < K; cf. Figure [5b). Now any 
algorithm computing / h-> Max (/)(1) = max{/(x) | < x < 1} on {0,gK,o, ■ ■ ■ ,gK,K-i} ^ 
C w [0; l]nLip 1 [0; 1] up to error 2~ n =: 1/(2K) must distinguish (every name of ) the identically 
zero function from (all names of) some of the gx,k (0 < k < K) because the first has 
max(0) = and the others max(gK,k) = ^-/K. Yet, since the gx are 'thin', any evaluation 
up to error 2 _m at some x with \x — k/K\ > m/K (i.e. a query to the given name ip) may 
return as approximation to gK,k{x). For a sequence (xj, 2~ m i) of queries that unambiguously 
distinguishes the zero function from the gx,k, the intervals [xj — \ Xj + -^-1 therefore must 
necessarily cover [0; 1] and in particular satisfy Ylj m j — K/2 = 2 n ~ 2 . On the other hand 
each such query takes f2(rrij) steps. 

For the second part of g) similarly observe JO = and Jq gx,k — f^ K 9k = Jq 9i/K 2 > 
1/{2K 2 ) =:2~ n . 

Turning to h), and on a more refined level, consider a hypothetical oracle machine M"^ 
converting a [p^y-^p^-nsime if) of f(x) = into a Lipschitz constant £ to /, necessarily 
so within finite time and when knowing finitely many values of and of a (w.l.o.g. non- 
decreasing) modulus p of continuity to /. Let n be so large that no p(n') with n' > n has 
thus been queried nor the values of / on any pair of arguments closer than 2 _n . It is no loss of 
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generality to suppose I > fJ,(n). Then it is easy (but tedious) to add to / a scaled and shifted 
Gaussian function 21 ■ <72 n ,fc for some (not necessarily integral) k such that the resulting / 
coincides with / on the arguments queried and has a modulus of continuity jl coinciding with 



Note the similarity of our lower bound proof of Example l2.6f +g+h) to arguments in information- 
based complexity |TWW 88)Hert02] generally pertaining to the BSS model. 

Remark 2.7 While aware of the conceptual and notational barriers to these new notions, we 
emphasize their benefits: 

— They capture numerical practice with various generalized condition numbers as parameters 

— based on, and generalizing, TTE to provide a formal foundation to uniform computation 

— on spaces of 'points' as well as of (continuous) functions 

— by extending discrete parameterized complexity theory 

— with runtime bounds finer than the global worst-case ones 

— while maintaining closure under composition 

— and thus the modular approach to software development by combining subroutines. 

In the sequel we shall apply these concepts to present and analyze uniform algorithms receiving 
analytic functions as inputs. 

3 Uniform Complexity of Operators on Analytic Functions 

For z £ C and r > 0, abbreviate ball(z,r) := {w G C : \w — z\ < r} and ball(z,r) := {w G 
C : \uu — z\ < r}. For U C C a non-empty open set of complex numbers, let C W {U) denote 
the class of functions g : U —> C complex differentiate in the sense of Cauchy-Riemann; for 
a closed A C C, define C U (A) to consist of precisely those functions g :C C — > C with open 
dom(g) D A. 

A real function / : [0; 1] — > M. thus belongs to C CJ ([0; 1]) if it is the restriction of a complex 
function g differentiable on some open complex neighbourhood U of [0;1]; cmp. [KrPa 02j . 
By Cauchy's Theorem, each such g can be represented locally around zq G U by some power 
series fa{z — zq) := Yl'jLo a j( z ~ z oY ■ More precisely, Cauchy's Differentiation Formula yields 



Now for a fixed power series with polytime computable coefficient sequence a = (aj) . , its anti- 
derivative and ODE solution and even maximurrj§ are polytime computable; see Theorem 13.31 
below. And since [0; 1] is compact, finitely many such power series expansions with rational 
centers zq suffice to describe / — and yield the drastic improvements to Fact 11.31 mentioned 
in Example 11.61 

On the other hand we have already pointed out there many deficiencies of nonuniform 
complexity upper bounds. For example the mere evaluation of a power series requires, in 
addition to the coefficient sequence a, further information; recall Example 12.3d ) and see also 
[ZhWeOll Theorem 6.2]. 

§Note that anti-/derivative and ODE solution of an analytic function is again analytic but parametric 
maximization in general is not. 



fi on {1, . . . ,n} and is still 2£-Lipschitz but not f-Lipschitz. 



□ 




(9) 
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The present section presents, and analyzes the parameterized running times of, uniform 
algorithm for primitive operations on analytic functions. It begins with single power series, 
w.l.o.g. around with radius of convergence R > 1; then proceeds to globally convergent 
power series such as the exponential function; and finally to real functions analytic on [0; 1]. 

Uniform algorithms and parameterized upper running time bounds for evaluation have 
been obtained for instance as [DuYa05, Theorem 28] on a subclass of power series, namely 
the hypergeometric ones whose coefficient sequences obey an explicit recurrence relation 
and thus can be described by finitely many real parameters. Further complexity consider- 
ations, and in particular lower bounds, are described in [Rett07] . [Rct08a Rctt09] . There is 
a vast literature on computability in complex analysis. For practicality issues refer, e.g., to 
[vdHo05 vdHo07 vdHo08] . |GaHol2] treats computability questions in the complementing, al- 
gebraic (aka BSS) model of real number computation [BCSS98J; see also [Brav05] concerning 
their complexity theoretic relation. For some further recursivity investigations in complex 
analysis refer, e.g., to [Her99b AnMc09] or [Escalli §6]. 

3.1 Representing, and Operating on, Power Series on the Closed Unit Disc 

|Weih00l Theorem 4.3.11] asserts complex power series evaluation (a,z) h-» fa(z) to be 
uniformly computable when providing, in addition to a pj y -name of z and a (p^J^-name of 
a = (aj) j C C, some r£Q with \z\ < r < R and some A £ N such that it holds 

Vj : \aj\ < A/r j , (10) 

where R(a) := l/limsup^ | a-j | 1 / J denotes the coefficient sequence's radius of convergence. 
Note that such A exists for r < R but not necessarily for r = R (consider a,j = j). Now 

Equation ([10]) yields the tail estimate | Ylj> n a i z3 \ — ^ i- \z\/r : non - un if° rm m \z\ ~ * r ~ > R- 
Indeed, any power series is known to have a singularity somewhere on its complex circle of 
convergence (cf. Figure [6k.) , hence its rate of convergence must deteriorate as \z\ —> R; and 
evaluation does not admit a uniform complexity bound in this representation. Instead we 
shall replace r 6 Q by an integer K describing how 'close' r is to R. For R < oo, by scaling 
the argument z it suffices to treat the case \z\ < 1 < R; (The case R = oo will be the subject 
of Section [331 below.) 

So consider the space C w (ball(0, 1)) of functions holomorphic on some open neighbourhood 
of the closed complex unit disc; put differently: functions g whose sequence a of Taylor coeffi- 
cients around according to Equation Q have radius of convergence R(a) > 1. C w (ball(0, 1)) 
may thus be identified with Cf from Example 12.3d ) in the following 

Definition 3.1 On the space Cf = {a C C,R(a) > l} ; consider the multivalued mapping 
(a) ^ (2 K ,A) G N with r := V2 < R(a) and Vj : \aj\ < A/r j and let ir := {p 2 Ay Y + 
binary(2^, A) denote the representation of C^ (ball(0, 1)) enriching a (p^ ^-name of a with 
advice parameters K in unary and A in binary (but not with R). 

Note how K encodes a lower bound on r < R. More precisely, large values of K mean r 
may be close to 1, i.e. the series possibly converging slowly as \z\ /*■ 1. Together with the 
upper bound A on all \aj\, this serves both as discrete advice and as a parameter governing 
the number of terms of the series to evaluate in order to assert a tail error < 2 _n ; see the 
proof of Theorem 13.3b ) below. Lemma f3.2d ) shows K to be of asymptotic order and 
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provides bounds on how to transform K computationally when operating on a. For example 
the coefficient sequence a'j = (j + 1) • Oj+i corresponding to the derivative has the same radius 
of convergence R(a) = R(af), classically, but does not permit to deduce a bound A' as in 
Equation (|10p from A without increasing r. 



(singularity) 




Fig. 6. Geometry of the parameters underlying a) representation tt and b) representations a, /3, 7. 



Lemma 3.2 a) Let r > 1. Then it holds t < C ■ r* for all t > 0, where C := l/(e • lnr). 
b) More generally, t s < (-^^p) s • r t for all t > and s > with the convention of 0° = 1. 
cj For all N G N it holds 1 + ^ < < 1 + ^. 
c£) Asymptotically l/ln(r) = 0(^rr) as r \ 1. 

WWi a G and (K,A) as in Definition \3.1\ for every \z\ < r' := 2 \/2 = y/r it holds 

\h{z)\ <A-^ and \fi d \z)\ < A ■ d!/(r> - l) d +\ d G N. 
f) For all k > 2 and x > k 2 it holds x k < exp(x). 

For all a, k > 1 and b > and x > k 2 ■ a l l k jb 2 > 4 it holds a ■ x k < exp(x • 6). 

Proof. Any local extreme point point xo of < x 1— )■ x • r _x is a root of -J^x • r _x = r~ x — ln(r) • 
x • r~ x , i.e. i • r - * < C := max{x • r~ x : x > 0} attained at Xo := l/ln(r). Replacing r with 
r V s yields b). For c) observe \/2 = exp(ln 2/iV) and analyze exp(x) on [0;ln2] B x := 1/N. 
Taylor expansion yields ln(l — x) ~ — ~ — — • • • for x := 1 — r. 

Regarding e), |/ B (*)| < ^Kl " kP'^ A- E^r'A)^!^ = ^ • ^ and < 

^ • Ei>,i • (j - i)-C; - + i)(NM H = ^E^'Uia' ^ ^i^Una^ ^ 

A'd\/(r f - l) d+1 . 

Turning to f), first record that k 2 < exp(fc) holds for all > 2. In particular x < exp(x/fc) is 
true for x = k 2 ; and monotone in x because of 9 x x = 1 < l/kexp(x/k) = d x ex.p(x/k) for all 
x > /c 2 . 

Concerning the second claim substitute y := x-a 1//fc and conclude from the first that y k ' al/k / b < 
exp(n) for all y > k 2 ■ a 2 / k /b 2 > 4. □ 



Theorem 3.3. a) Evaluation C w (ball(0, 1)) x ball(0, 1) 3 (f,z) H- f{z) G C is fully 

polytime (tt x Pdy)~ computable, that is within time polynomial in n + K + log A for 

the parameters (K,A) according to Definition \3.1[ 
b) Addition C w (bal(0,l)) x (7"(baII(0, 1)) 3 (/i,/ 2 ) ^ /1 + / 2 G C w (bali(0, 1)) is /«% 

polytime (tt x 7r, tt) -computable, that is within time polynomial in n + K\ + K~2 + log Ai + 

log A 2 . 
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c) Multiplication C7 w (baII(0, 1)) x C"(b5I(0, 1)) 3 (/i,/ 2 ) ^/ r / 2 € C7 w (baH(0, 1)) is/WJj/ 
polytime (w x tt,tt) -computable. 

d) Differentiation C u (baIT(0, 1)) 9 / (-»■ /' G C w (baIT(0,l)) is fully polytime (vr,7r)- 
computable. 

More generally d-f old differentiation C w (bali(0, 1)) xN 9 (/,d) H- /W G <7^(baTI(0, 1)) is 
polytime (jr + unary(d), 7r) -computable, that is within time polynomial in n + K + 
log ,4 + d. 

ej Anti- differentiation (7^(551(0,1)) 9 / ■->■ ff = F € (7" (551(0,1)) is fully poly- 
time {it, it) -computable; and d-f old anti- differentiation is fully polytime (it + unary (d), 7r) - 
computaWe. 

Parametric maximization, that is both the mappings MAX o Re and | MAX | /rom 
C w (bail(0, 1)) x [-1; l] 2 to K are /u% polytime (vr x p^ , pd y ) -computable, where 

MAX o Re : (f,u,v) i— )■ max{Re/(x) : min(u, u) < x < max(u, u)} and 
| MAX | : (/, u, u) i — y max {|/(x)| : min(n, v ) < x < max(u, «)} . 

^4s a converse to a), given a p® -name of f as well as K £ N and an integer upper bound 
B on max {|/(2;)| : \z\ < V2~} and j € N, f/ie coefficient aj = f^'(0)/j\ is computable 
within time polynomial in n + K + log B + j; formally: the partial function 

C w ([-1; 1]) x N x N 3 (/, K,B) ^ a : f = f- a , V|z| < ^2 : \f(z)\ < B 

is polytime (p^ y + binary (2^, B), „) -computable. 

Note that, for real-valued /, min{/(z) : z} = — max{— /(z) : z} and max{|/(z)| : z} = 
max(max{/(z) : z}, — min{/(z) : z}). Hence the above Items a) to f) indeed constitute a 
natural choice of basic primitive operations on C a; (ball(0, 1)). 

Proof (Theorem [TO)) . 

a) Given if, calculate r := y/2 within time polynomial in n + K. Then evaluate the first 
roughly N := n ■ K + log A terms of the power series on the given z: according to Equa- 
tion JTQJ the tail J2j>n Kl • M J < A • Ej>7v(M/ r ) j = A ■ (WAO^T^^Tf is then sma11 of 
order {\z\Jr) n ' K = 0{2~ n ) because of \z\ < 1. 

b) Given (a, K, A) and (b,L,B) output (c, M, C) where Cj := ay + 6j and C := A + and 
M := m&x(K, L). In view of Example 11.7b ). approximating Cj up to error 2~ m this is 
possible in time polynomial in m + log(^4 + B) + j ■ (if + L); now recall Definition 11.9b ) 

c) Similarly, given (a, K, A) and (b,L,B) output (c,M,C) where Cj := X^i=o°« ' an( ^ 
C is some integer > A • B • (l + M/(e • In 2)) where M := 2max(if,L). Indeed, with 

> (2)# and re > (2)£ and r = min(rA,r,B) > (2) A/, 1 < r' := (2)M < y/r < r 
implies j < Vr^/(e • In -y/r) < M • y/r 3 /{e • In 2) according to Lemma l3.2a ); hence \cj\ < 

Eio ^Ai • B A1f = ^ • b ■ (j + i)M < ci^P. 

d) Given (~K, A) output (d',K',A') with (a^) := ((j + 1) • a j+ i) and if' := 2if and A' some 

integer > 7 • (1 + ■^). Indeed, 1 < r' := (2)^ = ^ < ^ implies j < 2K ■ y/P /(eln2) 
according to Lemma [372k ) ; hence (j + 1) • < A'/y/r 3 . 

More generally, in view of Lemma [372b ). output ((j + 1) • (j + 2) • • • (j + d) • Oj+d) an d 
K':=2K a ndA'>^.d rf -(l + 2^>^.(l + |f4).(2 + |f4)...(d+|f|). 
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e) Given (a, K, A), in case d = 1 output a' := and a'j := aj-i/j and K' := K and A' > A- 



r. 



In the general case a'j = dj-d/j/ (J ~ 1)/ " " " /(j ~ d + 1) and A' > A ■ r' 



el 



f) First suppose that / |r_i ; i] is real, i.e. aj G M. Similar to a), the first d := 0(n ■ K + log A) 
terms of the series yield a polynomial p G D n+ i[A] of deg(p) < d with dyadic coefficients 
uniformly approximating / up to error 2~ n ~ 1 . In particular it suffices to approximate 
the maximum of p on [u',i/] up to 2~ n ~ 1 (for u',v' G D sufficiently close to u and t>, 
respectively). This can be achieved by bisection on y w.r.t. the following existentially 
quantified formula in the first-order equational theory of the reals with dyadic parameters 
which, involving only a constant number of polynomials and quantifiers, can be decided 
in time polynomial in the degree and binary coefficient length [B PR O 61 Exercise 11.7]: 

&(u',v',p ,...,p tl ^i) := "zb, r,s,t : x = vf + r 2 ^ A v' = x + s 2 ^ A p(x) =y + t 2 " 

>u' x<v' p{x)>y 

In the general case of a complex valued /|r_x ; i]j |/| 2 = Re(/) 2 + Im(/) 2 is uniformly 
approximated by the real polynomial q := Re(p) 2 + Im(p) 2 , thus max|/| 2 is polytime 
computable as above. Since both M. B t \— > t 2 and 3 s i— )■ y/s are monotonic and 
polytime computable, the same follow^ for max | / 1 = \Jraax. \f\ 2 . 

g) According to Cauchy's differentiation formula ([9]), Equation (jlOp is satisfied with A := B. 
Polytime computability of the sequence aj = f^'(0)/j\ from evaluations of /|r_i ; i] is due 
[Miill87] : cmp. also the proof of |Ko9H Theorem 6.9] and (that of) Theorem fOb) below, 
and note that both Re / and Im/ are real analytic. Since < A/(r' -I) 2 < A- (j^) 2 
according to a) and Lemma 13.2b ). we known that fJ,(n) = n + [log A + 21ogp|] is a 
modulus of continuity of /|r_i ; i] and can suffice with evaluations on the dense subset 
[-l;l]nD. □ 



3.2 Representing, and Operating on, Analytic Functions on [0; 1] 

We now consider functions / G C w [0; 1], that is functions analytic on some complex neighbour- 
hood of [0; 1]. Being members of Lip[0; 1], the second-order representation + binary (Lip) 
applies. On the other hand, / is covered by finitely many power series, each naturally encoded 
via 7T. And Equation [2] suggests yet yet another encoding: 

Definition 3.4 Let C"([0;1]) denote the space of complex-valued functions analytic on some 
complex neighbourhood of [0; 1] . 

a) Let M G N and x m G [0; 1] and a m j G C and L m G N and A m G N (1 < m < M, j G N). 
We say that (M, (x m ), (a mj ), (L m ), (A m )) represents / G C w ([0; 1]) if it holds 

M 

[0; 1] C |J [x m - jj^,x m + and / (i) (x m ) = a m ,j • jl and \a rn j\ < A m ■ L j m (11) 

m=l 

An a-name of f encodes (M in unary and, jointly in the sense Remark 1 1.81c ) for each 
1 < m < M the following: a p^ y -name of x m , a (p^ y ) u -name of (a m j) j as well as advice 
A m in binary and L m in unary with parameter (log ^4i, Li, log ^2, L2> • • • , log A m ,L m ) . 

b) Define second-order representation (3 to encode f via (see Figure^) 



We thank Robert Rettinger for pointing this out during a meeting in Darmstadt on August 22, 2011 



Parameterized Uniform Complexity in Numerics 27 



— a p^-name o/Re/|[ 0; i] 

— and one o/Im/|[o ; i], together with 

— an integer L in unary such that f G C u (1Zl), 
where TZl '■= {x + iy \ — < y < — < x < 1 + -^} 

— and a binary integer upper bound B to \f\ on said IZ^. 

c) A ^-name of f G C W ([0;1]) consists of a p^ y -name o/Re/|[ 0; i] and one o/Im/|j 0; i] 
enriched with advice parameters A (in binary) and K (in unary) such that \f^\x)\ < 
A-Ki ■ jl holds for all < x < 1. 

Again, the binary and unary encodings have been chosen carefully: Analogous to K in Def- 
inition [3J] upper bounding 1/(R — 1), the distance of the domain ball(0, 1) to a singularity, 
here 1/L constitutes a lower bound on the distance of [0; 1] to any complex singularity of /. 
Specifically the size of a /3-name ip of / is IV'K^) = &( n + L + log 5); and that of a 7-name 
is <9(n + K + log A). 

Example 3.5 a) For x m G [0; 1] and y m > (1 < m < M) the function z 1— > \\ m {{z — 

x m ) 2 + Um) 1 i s analytic on [0; 1] with complex singularities at x m ± iy m . 
b) The Gaussian function g\{x) = exp(— x 2 ) employed in the proof of Example \2.6f ) has 
(x) = (—I) 1 ■ Hj(x) ■ gi(x) with the Hermite Polynomials 

H = l, Hx(x)=2x, H n+1 (x) = 2x ■ H n (x) - 2n ■ H n ^(x) . 
A simple uniform bound on g[^ is obtained using Equation (0|): 

\g[ j \x)\ < £■ / |exp(-z 2 )|/l^ < j\e 

J\z-x\=l 

because | exp(— z 2 )\ = exp ( — Re 2 (z) + Im 2 (z)) < exp(l) due to \z — x\ = 1 with x G M. 

Hence in both cases, /|[o ; i] being large/steep or a complex singularity residing close-by, more 
time is (both needed and) granted for polytime calculations on /. Similarly for the parame- 
terized representation a. Also note that a 7-name of / encodes only data on the restriction 
/| [o : i] whereas both a and $ explicitly refer to the complex differentiable / with open domain; 
cmp. |KrPa02j . 

Remark 3.6 a) Both (3 and 7 enrich p^-names with different discrete information (and 
thus without affecting the nonuniform complexity where n is considered the only parameter) 
of the kind commonly omitted in nonuniform claims and are thus candidates for uniformly 
refining Example \l.b\ 

b) We could (and in Section^ will) combine in the definition of 7 the binary A with unary 
K into one single binary C := A ■ 2 K satisfying ||/^|| < C ■ (logC)-' • j! 

Theorem 3.7. a) On C w ([0; 1]), a and f3 andj constitute mutually (fully) polytime- equivalent 

(parameterized) representations, 
b) The following operations from Theorem \3.3\ are in fact uniformly polytime computable on 

C([0;1]): 

Evaluation (%), addition (ii), multiplication (Hi), iterated differentiation (l d ,f) 1— > f^ 
(iv), parametric integration (v), and parametric maximization (vi). 
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c) Composition (vii), that is the partial operator 

(9,f)^9of for /,(,eq[0;l]) with f\ m eC u ([0;l],[0;l]) , 

is fixed-parameter computable in the sense of Definition \2.JJh ). More precisely in terms 
of ((3 x f3, f3)-computability, given integers A,K with \ f{z)\ < A on TZk and (L,B) with 
\g( z )\ < B on TZl, g ° / is analytic on IZ2AKL and thereon bounded (like g itself) by B. 
Note that (only) the unary length of 2AKL is exponential in (only) the binary length of 
A. 

Similarly concerning (7 x ^f 7 j)-computability, f with advice parameters (A, K) and g with 
advice parameters (B, L) gets mapped to gof with advice parameters ( pp^x > K-(l+A-L)} , 
where the unary length of (only) the latter is exponential in (only) the binary length of A. 

Recall that, since both /3-names and 7-names have length 0{n + k) linear in n with constant 
parameter k, second-order polynomials here boil down to ordinary polynomials in n + k 
(Observation [TTHa +b+c) . 

Proof ( Theorem \3.7\ ). 

a) Since / is complex analytic on some U D [0; 1] open in C there exists an L £ N as required 
for a /3-name. The continuous |/| is bounded on compact TZl by some B. 

(3 7: The /9® y -names as part of the desired 7-name are already contained in the /3-name. 
Now observe that Cauchy's differentiation formula ([9|) implies \f^\x)\/j\ < B ■ LP for all 
jGN and all x £ [0; 1]. Hence A := B and K := L are suitable choices. 

7 a: Given A, K set L m := K and A m := A and M := + 1 and x m := (m — 
1)/(4K), noting that (M, Li, . . . , Lm, Ai, . . . , Am, xi, . . . , xm) can be computed within 
second-order polytime: with A m encoded in binary and L m unary, the output has length 
0(M • (K + log A)) compared to the unary encoding length Q(K + log A) of the input. We 
claim that also the sequences a m j = f^\x m )/j\ can be obtained within time a second- 
order polynomial in the size of the given 7-name. In order to apply Theorem l3.3g ) observe 
that, since \a m ,j\ < A ■ K 3 , the translated and scaled function f rn (z) := f(x m + ^ff) 
can be evaluated efficiently on D using the (/5-name of /; and is analytic on ball(0, 2) 
with Taylor coefficients a mJ := f$(0)/j\ = f^(x m )/(2Ky / j\ bounded by A/2*. Hence 
((flmjjj, (K := 1), A) constitutes an a-name of f m ; from which a mj - = a m j ■ (2K) 3 can 
be recovered. 

a ^ p /3: Let (M, (x m ), (a m j), (L m ), (A m )) denote an a-name of /. From |a mj | < A m • Lm 
observe that / is analytic on [j m ball(x m , 77-); which constitutes an open neighbour- 
hood of TZl for L := 2 • max m L m because of [0; 1] C Um=l [ x m ~ jt^,x m + 37^]; 
and / is bounded on TZl by max{| ^ • < M,z E ball(x m ,^-} < 

max m Y^j AmLin ■ -^- 3 = | max m A m . Both L and B > | max m A m can easily be calcu- 
lated in time polynomial in the parameter k = &(J2 m {L m + log A m )) . It thus remains to 
prove a < p as follows: 

Given x G [0; 1], some (of at least two) m with x 6 J m := [x m — jh^' Xm + 2E^\ can ' 3e 
found within time polynomial in ^2 m log L m : due to the factor-two overlap, it suffices to 
know x up to error jj^- Finally observe that f m (z) ■= f{ x m + 2l^) * s analytic on ball(0, 2) 

with coefficients a mj - = fm\o)/jl = a m j / (2L m y satisfying |a m j| < A m /2 J ; hence can 
be evaluated on ball(0, 1) by Theorem 13.3a ) within time polynomial in K + log A m + n 
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for K := 1. This provides for the evaluation within time polynomial in n and k of 
J m 3 x^- f m ((x - x m ) ■ 2L m ) = f(x), i.e. of /|[ 0; i]- 

b) Note that in view of a) we may freely choose among representations a, (3, 7 output and 
even any combination of them for input. 

i) Evaluation is provided by the pjj y — information contained in a 7-name of / together with 
the Lipschitz bound < AK of binary length polynomial in k = 0{K + log ^4). 

ii) Given /3j y -names of /i,/2 and L\,L2 in unary and binary .81,-82 according to j3, output 
a p^-name of f ■= fi + /2 (Example 12.6a ) and L := max(Li, L2) and B = B\ + B2. 

iii) Similarly with f ■= fx ■ $2 and L := max(Li,L2) and B := B\ - B2. 

iv) Given an a-name (M, (x m ), (a m j), (L m ), (A m )\ of / and in case d = 1, (the proof of) 
Theorem 13.3d ) yields A' m such that the coefficients a' m - = (j + 1) • a m j + i = (j + 1) • 

a mj+1 /(2L m y +1 of f' m {z) = £f(x m + g^) satisfy \a' m J < A' m /V2 j . Note that the 

bounds \a! m J\ < A' m • on a' m j = a' m j ■ (2L m y thus obtained apply to L' m = \f2L m 
and hence may fail the covering property of Equation (jlip . Nevertheless they do support 
efficient evaluation of f' m on ball(0, 1) by Theorem 13.3a ). but now with K := 2. Given 
x 6 [0; 1], similarly to the above proof of "a z< p /3" some J m containing x can be found 
efficiently and used to calculate f'(x) = f' m \{x ~ x m) • 2L m ) • 2L m . This provides for a 
pj y -naine of /'; as part of a 7-name to output. And for given (K, A) satisfying \fU'(x)\ < 
A-K'-jl, Lemma[32Ji) implies \(f')®(x)\ = \ f (j+1 \x)\ < AK-(J+l)-K^-j\ < AK-(2K)i-j\ 
since < 1; hence (AK,2K) yields the rest of a 7-output. In case d > 1, similarly, 
\f( d +i)(x)\ < AK d -(j+l)--- (j+d)-Ki-j\ < A-(dK) d -(2K) 3 -j\ according to LemmaE^b); 
hence output [A ■ (dK) d , 2K^j of binary length polynomial in d (sic!) and K + log A. 

vi) Given < u < v < 1 and an a-name (M, (x m ), (a m j), (L m ), (An)) of /, the idea is to 
partition [u; v] into K < 0(m) sub-intervals Ik = [uk',Vk] each lying completely within 
some J m and then apply Theorem 13. 3f ) to f m (z) := f(x m + jT^) m or der to obtain 
yk := max{/(x) : x G 1^} and finally max{/(x) : u < x < v } = max{yfc : k < K}. 

It follows from the proof of 7 :<p a that we may w.l.o.g. suppose L m = L and (x m ) 
increasing with equidistance < Jr. So find some 1 < m < m' < M with u S J m and 
v G J m '. Then u\ := u and t>i := min (y,x m + 7^) yield the first interval; the next are 
given by Uk+i := vu and f^+i := x m+ k + > %+i (1 < A; < m' — m — 1); and the last 
by u m i— m '■= v m '— m -i and v m i— m := max (u,x m ' — 2l). 

v) Similarly to vi) but now with y^ = f(x) dx = F{vk) — F(uk) a local anti-derivative of 
/ according to Theorem I3.3e ) and f, f(x) dx = ^ fc yk- 

vii) Looking at (/3 x /?, /?)-computability, in view of Example 12.6b ) it remains to obtain, 
given integers (L,B) with \g(z)\ < B on TZl and A, X with |/(-z)| < A on 7^-^, similar 
quantities for g o /. To this end employ Cauchy's differentiation formula to deduce 
|/'(z)| < A ■ (2K) on 1Z2K- Now the Mean Value Theorem (in Rez and Imz considered 
as two real variables!) implies \f(x) — f(x + z)\ < 2AK ■ \z\ < 1/L for x £ [0; 1] and 
z G 1Z-2AKL- Together with the hypothesis of / mapping [0; 1] to [0; 1], this shows / to 
map IZ2AKL to TZl ^ dom(g). Therefore go f is analytic on some open neighbourhood of 
TZ2AKL and thereon bounded (like g itself) by B. 

Concerning (7 x 7, 7)-computability, the proof of [KrPa02l Proposition 1.4.2] using 
the formula of Faa Dl Bruno (cmp. below Fact I4.4F ) shows that \f^\ < A ■ K 3 ' ■ jl and 
\ g U)\ < B-V -j\ imply | (50 /)(?') | <C-M 3 -j\ where C := and M := K- (1 + A-L), 

□ 
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3.3 Representing, and Operating on, Entire Functions 

As has been kindly pointed out by Torben Hagerup, the above Theorems 13.31 and 13.71 both 
do not capture the important case of the exponential function on entire R (Example 12.3a ) or 
C. 

Definition 3.8 On the space = {a C C,R(a) = oo}, a e-name tp of a = {aj) - S is 
a mapping ip : {0, 1}* — > {0, 1}* of the form 

l n a n bin {B{n)) 

where a is a (p 2 ly ) u ' -name of a and B : N — > N a function satisfying 

VMGNVieN: \aj\ < B(M)/M j . (12) 

Note that this second-order representation has names of super-linear length, that is, employing 
the full power of second-order size parameters. Indeed, every mapping B : N — > N gives rise 
to an entire function with Taylor coefficients aj := inf^/ B(M)/M J . 

Theorem 3.9. a) e is a second-order representation, and it holds e\ 1 :<p tt 
hi) Evaluation 

C^xC 3 (a,z) ' ^ J2j a i zj G C 

is (e, (p\ y ,\p 2 Ay \), p 2 Ay ) -computable in second-order polytime. 
bii+iii) Addition and multiplication (i.e. convolution) on are (ex e, e)- computable in second- 
order polytime. 

biv+v) Iterated anti-/ differentiation x N 3 (f,d) >-> f^ d ^ is [e + unary (d), e) -computable 
in second-order polytime. 
bvi) Parametric maximization according to Theorem \3.3f ) of entire functions on real line seg- 
ments (that is on x M. 2 ) is (e, (p Ay , | y0^ y | ) , Pd y ) -computable in second-order polytime. 
bvii) Composition x 3 (f,g) >->• 9 ° / G is fixed-parameter (e x e, e) -computable. 
More precisely, given a and B = B(M) with \aj\ < B{M)/M :> and f(z) := ^2jOjZ J as 

well as b and A = A(N) with \bi\ < A{N)/N l and g(w) := EjMA c k := (g o f) {k) (0)/kl 
has \ck\ < 2A(AB{2M)) /M k . Note that converting N := AB(2M) from binary to unary 
for invoking A(N) is the (only) step incurring exponential behaviour. 

In the case of the exponential function with aj = in order to bound AP /j\ = — jrj ' ' ' x 
independent of j, it suffices to treat the case j = M since additional factors with j > M 
only decrease the product. Now according to Stirling's Approximation, B(M) := M M /M\ < 
C(exp(M)) grows singly exponentially, i.e. has binary length (coinciding with |^|(M) — 1) 
linear in the value (!) of M. Example 12.3a ) therefore indeed constitutes a special case of 
Theorem 133b i) , 

Proof (Theorem \3. 9) . 

a) Since an entire function is holomorphic on every disc ball(0, M + 1), Equation 1101 applies 
to every r := M; hence B() exists. Concerning the reduction, it suffices to take K := 1 
and A := B{2) in the 7r-name. 
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bi) Similar to the proof of Theorem 13,3a ). evaluate the polynomial Ylj<N a j zJ with N := n + 
1 + log A terms, where A := B(M) and M > 2\z\: clearly feasible within time polynomial 
in n + \z\ and B(), that is the (second-order) length of the given e-name ip of a. 

)ii) For addition transform (a,) and (bj) into (a,j +bj) as well as M i— > B(M) and M i— > A(M) 
into M i-> B(M) + A(M). 

iii) Cj := Ei=o a « • fy-i satisfies \ Cj \ < B{2M)/{2Mf ■ A{2M)/{2My~ i = (j + 1) • B(2M) • 
A(2M)/(2My' < C/AP for all j, where C is some integer > A{2M) ■ B(2M) • ^ since, 
according to Lemma |3T2r ) . j + 1 < . 2 J+1 . 

iv) Similarly, according to Lemma 13.2b ). |(j + 1) • (j + 2) • • • (j + d) ■ aj + A < (i + d) d ■ 
B(2M)/(2My +d < B'(M)/M j for N 3 B'{M) > B(2M) ■ {-^-) d / {2M) d . 

jv) Observe || • ^ • ■ ■ ■ aj - d+1 \ < B(M)/M^ d+1 . 

vi) As in b i) and the proof of Theorem I3.3F ) , use real quantifier elimination to approximate 
the maximum of the polynomial consisting of the first n + 2 + log B(M) terms of f's Taylor 
expansion. 

vii) Instead of explicitly expanding £^ 0j( CLjzty , note similarly to Lemma [3.2b ) that w := 
f(z) has |w| < 2 • S(2M) for |z| < M; and analogously < 2,4(4 J B(2M)) =: C(M) 
for | to | < 2B(2M). Then Cauchy's Differentiation Formula ([9]) yields the claim. □ 



4 Complexity on Gevrey's Scale from Real Analytic to Smooth Functions 

This section explores in more detail the complexity-theoretic 'jump' of the operators of max- 
imization and integration from smooth (A^P-hard: Fact 1 1 . 3[) to analytic (polytime: Exam- 
ple ll .6j) functions. More precisely we present a uniforrrH refinement of [LLMOll §5.2] asserting 
these operators to map polytime to polytime functions on a clas£3 much larger than C°° (and 
even than the oitasi-analytic functions) which, historically, arose from the study of the regu- 
larity of solutions to partial differential equations |Gevrl8j : 

Definition 4.1 a) Write Giak\~ lj 1] f or the subclass of functions f € C°°[— 1; 1] satisfying 

V|x| < 1, Vj € N : \f (j) (x)\ < A-K j ■ j je ; (13) 

G e [-l;l] := \J AK ^G iA , K [-l;l] and G[-l; 1] := U teN Gi[-1; 1]. 
b) Let A denote the following second-order representation of G[— 1; 1]: 

^4 mapping ip is a X-name of f 6 G^[— 1;1] i/ £/iere exists C G N swc/i i/iai, /or every 
n E N, ip(l n ) is (the binary encoding of) an m-tuple (ao, • • • , a m -i) S Dm; m = C ■ n E , 

such that g m {x) '■= ao + o>i% H + Om-i^" 1 1 ^-as ||/ — <?m|| < 2~ n . 

Let a 7-name of f £ G([—l; 1] 6e a mapping 

{0,1}* 9 rtf ^ l^^+I^OV^) G{0,1}* , 

where ip denotes a -name of f satisfying Equation flgj) . PFe regard 7 as second- order 
representation with unary advice parameter K + logA in the sense of Definition \2.Jfc ). 

"Referring to [LLMOll Definition 2.2.9], [LLMOll Corollaire 5.2.14] establishes 'sequentially uniform' 
polytime computability of the operators in the sense of mapping every polytime sequence of functions to a 
polytime sequence. This may be viewed as a complexity theoretic counterpart to Banach-Mazur computability, 

cmp. e.g. [WeihOOl §9.1]. 

**We thank Matthias Schroder for directing us to this class and to the publication [LLM01| . 
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For £ = 1, Definition 14. lb ) is equivalent to Equation ([2]) by virtue of Stirling, i.e., C w [— 1; 1] = 
Gi[-l;l] holds. 

Example 4.2 a) The standard example h(x) = exp(— l/|x|) of a smooth but non-analytic 
function belongs to G^,{— 1;1]. 

b) The function hL from Example \1.14\ is smooth but not in G[— 1; 1]. 

c) Extending Example \2.6f ). fix £,N £ N and let ge,N,k(%) '■= <7l(A^ ' x ~ k) / e l+N '^l e with 
gi(x) = exp(-x 2 ). Then g ijN;k £ 1]. 

Proof, a) Similarly to the proof of Example 13.5b ). write h^ n \x) = x~ 2n ■ h{x) ■ p n (x). So 
Po = 1 and, for n > 1, p n (x) = x 2 ■ p' n _i{x) + (l — 2(n — l)x) -p n _i(x) shows p n to be an 
integer polynomial of deg(p n ) = n — 1 with leading coefficient equal to (— l) n+1 • n! and 
each coefficient bounded by n\. In particular ||p n || < C(n) n , while (0; 1] 3 x i-» x~ 2n • g(x) 
attains its maximum at x = ^- of value C(n) 2n : hence < 0(n) 3n . 

b) Recall that h L = *£ NeL h N , where the h N {x) = h(2N 2 ■ x - 2N)/N lnN have pairwise 

disjoint supports. Therefore ||/i^(x)|| = sup N£L h$ = sup 7VgL \\h^'\\ • 2 N 2j ' /N ln N , where 
su PjVeL iV 2 ViV ln7V > (2J) 2 V(2 i ) jln2 > 2* a . 

c) Note ^g ltN , k {x) = N l 3/exp(l + N£/e) ■ g[ j) {N e ■ x - k) with \g[ j) (y)\ < j\ ■ e < f ■ e 
according to Example [33b); and = ^ In (N tj / exp(N£/e)) = -^tjlnN - N£/e = 
£j/N — Ije shows by monotonicity of In that sup^r N i f exp(A^/e) is attained at iV = je 
of value fi. □ 

As did Fact Ol for C w , pXMOl} Corollaire 5.2.14] asserts Max and / and d to map 
polytime functions in G[— 1; 1] to polytime ones - again nonuniformly, that is for fixed / and in 
particularly presuming I, A, K according to Definition 14.1k ) to be known. The representation 
7 from Definition 14.1b ) on the other hand explicitly provide the values of these quantities. 
More precisely by 'artificially' padding names to length log A + K + n , instances / with 
large values of these parameters are allotted more time to operate on in the second-order 
setting. Our main result (Theorem 14. 6p will show these parameters to indeed characterize the 
uniform computational complexity of maximization in terms of Gevrey's scale of smoothness. 
Nonuniformly, we record 

Remark 4.3 For fixed £, A, K £ N ; a function f £ Gh^a,k is polytime (pd y , Pdy) -computable 
iff it has a polynomial-time computable j-name ip. 

Before further justifying Definition 14. lb ) +c) — including the re-use of 7 — let us recall some 
facts from Approximation Theory heavily used also in |LLM01|AbLe07| : 

Fact 4.4 For a ring R, abbreviate with R\X\ m the R-module of all univariate polynomials 
over R of degree < m. Let T m £ 7L\X\ m denote the m-th Chebyshev polynomial of the first 
kind, given by the recursion formula Tq = 1, Ti(x) = x, and T m+ i(x) = 2xT m (x) — T m _i(x). 

a) For g £ R[X] m+1 it holds \\g'\\ < m 2 ■ \\g\\ and \\g^ \\ < ^-(^-i 2 )-^-^)^^-^) . ^ 

b ) With respect to the scalar product 

(f,g) := J 1 J(x)-g(x)-(l-x 2 )- 1 / 2 dx = £ f (cost) ■ g (cost) dt 
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on C[— 1; 1], the family T = (T m ) m of Chebyshev polynomials forms an orthogonal system, 
namely satisfying (Tq,Tq) = it and (T m ,T m ) = ir/2 and (T m ,T n ) = for < n < m. The 
orthogonal projection (w.r.t. this scalar product) ^T,m{f) of f G C[— 1; 1] onto M[X] m is 
given by 

Pr,m(/) := c/,o/2 + c fc (/) • T k , c k (f) := £ • (/, T k ) 

Moreover \\f - P r ,m(/)|| < E fc > m M/)l and |c m (/)| < £ • ||/- g\\ for every g G R[X] m . 
c) The unique polynomial I-T, m (f) G M[-X"] m interpolating f G C[— 1; 1] at the Chebyshev 
Nodes x m j := cos (§^-)j < j < m, is given by 

m—1 m—1 
lT>(/) := X] Vm,kU)- T k, Um,k{f) ■= ^ ' f (x mfi ) ■ T k (x mfi ) + ^ ■ f(x m ,j) • T k (x m j) 

k=0 j=l 

and 'close ' to the best polynomial approximation in the following sense: 
Vg G M m : ||/-I r ,m(/)|| < (2 + flogm) -H/-5II . 
dj To f e C k [-1; 1] and kmeN £/iere exists g G IR[X] m smc/j i/ia< 



11/ -.'/II n (f) fc -^ 7— n • 

m • (m — !)••• (m — k + lj 



e J Xf<7m converges pointwise to f, and if all the g m are differentiate, and if the derivatives 

g' m converge uniformly to g, then f is differentiate and f = g. 
f) The Formula of Fa a di Bruno expresses higher derivatives of function composition: 



fei,...,fc„eN 

fci +2&2H h«fcn=H 

where k := k\ + k2 + ■ ■ ■ + k n . In particular ^2 kl kn kl \. k ^{... k \ ■ R k = R ■ (1 + R) n ~ l for 
n G N and R > 0. 
gj According to Stirling, \/2vr • n n+1 / 2 • e~ n < n! < n n+1 / 2 • e 1_n . 

Claim a) are the Markov brothers' inequalities. Claim b) is mostly calculation plus [Chen66| 
Theorem 4.4.5iii] and [LLMOU §5.2.2]. The nontrivial part of Claim c) bounds the Lebesgue 
Constant; cmp. |Rivl74[ Theorem 1.2]. For d) refer, e.g., to |Chen66l Jackson's Theo- 
rem 4.6.Viii]. Claim f) can for instance be found in [KrPa02l §1.3+§1.4]. 

The following tool provides quantitative refinements to [LLMOU Theoreme 5.2.4]. 

Proposition 4.5 a) For < r < 1 and < q < 1 and p > and N G N it holds 
y r n9 -(n-iy < 7r i.(2.^±^) (1 - q+p)/q .Vr~ Nq 

Z_^ n >JV 2<j-lnl/r V q-e-lnl/rJ v 

b) Let < q,r < 1 < B. Then B ■ r mq < 2~ n holds for all m > C ■ n 1 ^, where C := 



1 + log Bj log j) 1 ^ ■ Conversely, for < q < 1 < C, (Vm > C ■ n x l q : e m < 2~ n ) {rapi- 



nes 



e m <2- r m " wtth \<r:=2~ c 9 < 1. 
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c) Suppose f £ C°°[— 1; 1] satisfies Equation $13\) with parameters A,K,£ > 1. Then to every 
m G N £/iere exzsis g m 6 R[X] m with 

\\f-9m\\ < B-r mq (15) 

w/iere q := l/i, 2~ 1 / { - 2 ^ < r := ^-^r q <1, B := A - (2 + ttK). 

d) Conversely suppose 0<r,q<l<B and f : [—1; 1] — > M are such that to every m £ N 
there exists some g m £ M[X] m satisfying Equation I75|) . T/ien / is smooth and satisfies 
Wf^-g^W < B d -^? mq withB d := B-( lf ^ TF ) {l+2d)/q . Moreover f obeys Equation 

wtth i := 2/q — 1, A := B ■ (^j-^ , and K := 4 ■ (^f q . 

e) Suppose f £ C°°[— 1; 1] satisfies Equation (T3\) . To m £ N Zei g m £ D m [X| m denote the 
polynomial lTm(/) with coefficients 'rounded' to D m . Then it holds \\f — g m \\ < B-^/r" 1 
with B := 1 + 2B ■ ( e .£\/ r ) f or r and B according to c). 

f) For f £ Gt[-l;l], f £ G e [-l;l]. More precisely, Equation implies \\f {d+j) \\ < 
A d -K J d - ji £ for A d := A • L • (2 • d 2 • i/e) M and K d := K ■ e ■ (2d) e . 

g) For f,g £ G £ [-l; 1], f ■ g £ 1]. More precisely, \\f^\\ <A-K*- j jt and \\g0)\\ < 
B-V ■ j je imply \\(f ■ g)W \\ < C • M* • j ji for C := A ■ B and M := K + L. 

h) For f,g £ G e [-1; 1] with f : [-1;1] -> [-1;1], go f £ More precisely, \\f^\\ < 
A-K n -n nl and \\g^\\ < B-L n -n ni imply \\{gof)^\\ < C ■ M n ■ n ni for C := £-(e-£/2)^ 2 
and M := e • A- K ■ L. 



Note that, in case I = 1 = q, Claims c) and d) together characterize G%[— 1; 1] = C w [— 1; 1] in 
terms of function approximability by polynomials [DeYilO] but leave a gap in cases q < 1 < £; 
cmp. [LL MOU Remarques 5.2.5(4)]. As a consequence, the proof of Theorem 14.6a ) below 
will show ; y\ Ge A| G£ uniformly in I but 'only' A| Gf 7I 2<_1 : with consequences to the 
proof of Theorem 14.6b ) below. 

We postpone the proof of Proposition 14.51 in order to first state our main 

Theorem 4.6. a) Up to second- order poly time equivalence, Definition ^. generalizes and 
extends Definition \3.Jfc ) from C w [— 1; 1] to G[— 1; 1]. Moreover, 7 is second- order poly time 
equivalent to A constituting another second-order representation of G[— 1; 1]. 

b) The following operations are uniformly polytime X-computable on G(\— 1; 1]: 
Evaluation (i), addition (ii), multiplication (Hi), iterated differentiation (iv), parametric 
integration (v), and parametric maximization (vi). 

c) Composition (vii) as the partial operator 

(9,f)^9of for f,g€G e [-l;l] with f : [-1; 1] -+ [-1; 1] 

is fixed-parameter (7 x 7,7) -computable. 

d) Fix I £ N. Then (pJjLPdy) -computing Max restricted to £^4.1,1,1 [— 1; 1] requires time at 
least Q{n l ). 

Proof (Theorem \4-6\ ). 

a+bi) Every / £ Gi[— 1; 1] has a 7-name ijj of length \ip\(n) = log A + K + nr . For / £ C w [— 1; 1] 
a second-order polynomial in n and n 1— > log A + K + n amounts, to a bivariate polynomial 
in n and k := log A + K; recall Observation 11.18b ). Moreover k can be recovered from 
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and any bound A ■ K 3 ■ j 3 according to Equation (113j) with k = log A + K is in turn 
dominated by A' ■ K' 3 ■ j\ for A' := 2 k / ^/2tt and K' := k ■ e by virtue of Stirling (Fact IPf ) 
with both .A' in binary and K 1 in unary computable from ip within second-order polytime; 
hence Definition 14.1b ) indeed extends Definition 13.4b ). 

In order to see 7 :<p A, recall that ||/'|| < A ■ K implies evaluation G[— 1; 1] x [—1; 1] 9 
(f,x) 1 y f(x) be second-order polytime (7, /?d y , Pd y ) _ computable according to Exam- 
ple [TTT9b)+e)+f). Now note that, for B',r from Proposition I4.5b +e). C according to 
the first part of Proposition l4"3b ) is polynomially bounded in log A + K; hence interpolat- 
ing / on m = C ■ n e Chebyshev nodes x m fi, . . . , x mim _i from Fact I4.4H ) is feasible within 
time a second-order polynomial in n and n h-> log A + K + n . 

Conversely, the polynomial g m in a A-name ip of / yields approximate evaluation of / 
within time a second-order polynomial in the output error n and the length ~ 
m 2 = (C • n^) 2 and in particular allows to obtain a p^ y -name. Moreover the parameters 
C (in unary) and £ are easily recovered and lead to I' := 2£ — 1 and A, K satisfying Equa- 
tion (|13p according to the second part of Proposition 14.5b ) and Proposition 14.5b ); in fact 
both the binary length of A and the value of K (i.e. in unary) are polynomially bounded 
in (the value of) C and exponentially in £, hence allowing also the map w 1— > i lo s ^4+^+1^1* 
to be computed within time a second-order polynomial in n and in n 1— > (C ■ n/) 2 . 

bii) Given sequences /„, G D m ,(„)[J] m ,( B ) with mf(n) = Cj • n e and ||/ — f n \\ < 2~ n as well 
as g n G D m9 ( n )[X] m9 ( n) with m g (n) = C g -n l and \\g - g n \\ < 2~ n , output f n+1 + g n+1 G 
n m f+g (n)[X] mf+g (n) where m f+g (n) := max{C f ,C g } • n e . 

biii) Given a A-name ifif of /, observe that ||/|| < 1 + ||/o|| < 1 + |arj,o| + l a i,o| + • • • + |«c /5 o| < 
2°W/I( )I) where ^f(l n ) encodes the coefficients of f n G D m/ ( n )[X] mf ( n ) in binary with 
m/(n) = C/ • n £ . Now in view of ||/ • g - f n ■ g n \\ < \\f\\ ■ \\g - g n \\ + ||/ - f n \\ ■ \\g n \\ it 
suffices to output f n > • g n > G B mf g{nf) [X] mf g{n>) for n' = 0{n + |^/|(0) + \ip g \(0)), where 
mf. g (n) = mf(n) + m g (n) = (C/ + C s ) • ?/. 

biv) Given a sequence / n G D m ( n )[X] m ( n ) with ||/— / n || < 2~ n for m{n) = C-n £ , combine Propo- 
sition |45b+d) to see that f^\ nACtd) G Om^.^c^Wm^.^c^) satisfies ||/ - fx\ nt tfi,d)\\ < 
2~n £ or jy, M polynomials in n , C, £ , and in particular bounded by second-order 
polynomials in d and in n 1— > C ■ n , i.e., in the input size. Indeed: C leads, according 
to the second part of Proposition 14.5b ). to B := 2 and r := 2~ c ' 1 ' /f ; then furtheron to 
Bd := 2 ■ ( g. e .ini/ r ) an d according to the first part of Proposition 14. 5fl ): and fi- 

nally, according to the first part of Proposition 14.5b ). to Cd := (1 + ]^j^Y polynomially 
bounded in d e ,£ e , and C > ft ((log C) e ) . 

bv) Given a sequence /„ G E> m ( n )IXIm(n)> 11/ ~ /n|| < 2~ n , it obviously holds || / /- / / n || < 

bvi) Similarly, maximize f n as in the proof of Theorem I3.3f ). 

c) The estimate ||/'|| < A • K yields 7 /?^ y + binary(Lip) and thus a /)J y -name of g o / 
according to Example 12.6b ). The binary parameter logC + M for g o / can be obtained 
from log ^4 + i^T of / and from log B + L of g due to Proposition 14. 5h ) and are independent 
of n. 

d) Similarly to the proof of Example I2.6C ) . recall the functions ge.,N,k £ G^+i^^f— 1; 1] from 
Example 14.2b ) satisfying g£,N,k(k/N £ ) = ex.p(N ■ £/e + 1). and ge t N,k{x) < exp(^ • £/e) 
for |x — k/N \ > 1/N . Hence any algorithm computing / 1— > max{/(x) | < x < 1} on 
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{0,ge,N,o,---,9e,N,N-i} Q Gt+i,i,i[-l; 1] up to error 2 n ,n =: (2 + N ■ £/e)/1ne, must 
distinguish (every name of) the identically zero function from (all names of) each of the 
9i,N,k (0 < k < N ). Yet, since the fe t N,k are 'thin', any approximate evaluation up to 
error 2~ m at some x with \x — k/N \ > m/N e . could return 0. □ 

Proof (Proposition |^.5| ). 

a) Since n — 1 < x < re implies r n<l < r x<1 and (n — l) p < x p , it follows r"' • (n — l) p < 
f", r xq ■ x p dx and Ylm>N ^ ' ( n ~~ 1) P — Jjv° ^ ' xP ^ n * ne latter integral substitute 
y := x q ■ ln(l/r), ranging from M := N q ■ ln(l/r) to oo; moreover x = ( , ) 1 ^ 9 and 



■gjj: = Q ' ln(l/r) • x 9-1 = g • y/x = y 1-1 / 9 ■ q • ln(l/r) 1//l3 . The integral thus transforms into 



e 



M xlnl/r/ ■ ■ j M 

with s := (1 +p)/q — 1 > 0. According to Lemma l3T2b ) . y s < ( eln s ^ ) s • e^ 2 ; yielding the 
bound 

f oo 



/•oo 

/ e^-y^y < (^) s • e M / 2 /2, 



b) Taking binary logarithms on both sides shows the claim equivalent to m > ( ^^h^t ) ; 
and the latter is < C ■ n l l q . 

Given m, considering n' := [(m/C) q \ > (m/C) q — 1, the largest n with m > C ■ n l l q , 
implies e m < 2~ n ' < 2 1 -(™/c*)< 3 = 2 ■ r m " . 

c) Following [LLMOll p.324], Fact OB ) implies ||/ - g m \\ < A ■ (f^ • A/) fc for every kN. 
Now choosing k := (^flr) 1 ^ would yield the bound A ■ r ra '; but k must be integral. To 
this end observe that the claim does hold in case k = 1 by means of B > A; and for 
non-integral k > 1 (where necessarily ^ - A; < 1), there exists an integer k! between k — 1 

and k: yielding (§£ • k' e f < (§£ • k^f' 1 = 2r m " . 

d) Observe that triangle equality yields, in connection with Fact 14.4b ). \\g$ — g^-iW — 
(m - l) 2d ■ 2B ■ r mq ; hence, for N > re, 



11^-^11 = 11^ < (m-l) 2/ 

II * — 'm=n+l ' — 'm>n 



Now apply a) to conclude \\gjy — g^\\ < -B<i • -v/F" 1 independent of N, showing {g^) m to 
be a Cauchy sequence in C[— 1; 1] with uniform limit according to Fact I4.4e ). 
On the other hand, Fact 14.4b ) asserts |c m (/)| < B ■ — ■ r mq ; from which a) together with, 
again, Fact [Ob) implies / = lim m Pr,m(/) = co(/)/2 + J2 m >i c m (f) • T m with respect to 
uniform convergence, and thus (Fact | 



HZ 00 !! = HE > .Cm(f)-T^\\ < > .\Cm(f)\-m^/j\ 
ii z — 'm>j 11 * — 'm>j 

according to Fact 14.4b ). observing 1 • 3 • 5 • • • (2j — 1) > j!. Now with m 2j /j! < (2 • (m — 

we can invoke a) for p = 2j and for p = to continue bounding 

<B-C.£-4?-(C- jY 2 ~ 2q+2j)/q /jl, C := 6/{qe In i) 
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since 1 — q < 1 < j < 3j and by generously replacing the sum of the two large terms with 
their product. Moreover C ■ C^- 2q ^ q < C 2 ^, j( 2 - 2 i)/i < < (^f /q ■ & by virtue of 
Lemma[32b), and j! > V^r ■ j j+1/2 ■ e~ j due to Stirling (Fact OF)- 

e) By c) and Fact [Ob), ||/ ~~ 9m 1 1 ^ B ■ r m • (2 + ^ log m) + m • 2 m since the rounding 
changes m coefficients by < 2 _m . Now 2 + | logm < 2 • log(2m) < 2m < 2 • ( e ,^\/ r ) ■ 
(l/v / r) ml/ ' < because n := m 1 ^ has m = n e < ( g^rfrrTf ) " V^"™ according to Lemma [3.2b ) . 
Similarly, Lemma [3.2a ) yields m < (2i/f) m because r > 2 _1// ( 27r ) implies - < 1; 
hence m • 2~ m < ^Jr nl . 

f) By hypothesis < A ■ L d +i ■ (d + j)( d +^ e ; and d + j < 2dj implies (d + < 
/ £ . (2d) M ■ {{2df) j where j M < (d£/e) d - e ■ e j by virtue of Lemma EjZb). 

g) According to the General Leibniz Rule, 



\\(f-g) {j) \\ < A- B ■ jy k=Q (l) K k • V~ k • k M • (j - fc) 



<jke.jU-k)t—jj£ 



h) Following [G evrl8[ §1.2.1], we first record that induction on n in the Faa di Bruno's 
Formula (Fact I4.4F ) shows (i) the coefficients , vki , ^ — fc , ^ !fcn to all be nonnegative 
integers. Secondly (ii), according to Stirling, 

Y. kl _ kn WW. ■ Rk ■ (^AO* 1 • (2 2 /2!) fc2 • • • (n»/nl)*" 
^ E fcl ,..., fen Snfa • ( e • R t/^ ■ (e 1 /^)* 1 • -(e 2 /v^) fc2 • • • • (e n /V2^) k - 

= e n /V2^-(e-R/V2^)-(l + e-R/V2^) n ~ 1 < (e ■ R) n 
for R > 1 by virtue of Fact 14. 4f ) . Now we can bound ||(5o /)(«■) || with 

e w^a...^ ■ i^ 71 " ■ kk • ( ii ) fci • • • • w-y 

X j- • • 3 fen 

<B-K--{ J2 kl ^. k J^. kn ^ ■ <^t ■ k k • (l 1 )* 1 • (2 2 )^ • • • {n*)**) 1 

fel j.. . j fc/i 

< B ■ K n ■ (n\ ■ (e ■ ^A^L) n ) e 



where n\ ni < n nl - • (n 1 / 2 ■ ef ■ e n ^ and n^/ 2 < ^/T/(2e) ■ e n according to Stirling and 
Lemma l3.2b ). □ 

5 Conclusion and Perspectives 

We have constructed a parameterized and two second-order representations of the space 
C w ([0; 1]) of analytic functions on [0; 1]; shown them second-order polytime equivalent; and 
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to render the basic primitives second-order polytime computable. In view of Remark 13.61 this 
subsumes the known nonuniform results from Example II. 6| but now 

a) explicitly specifies the additional discrete information employed 

b) and an asymptotic running time analysis taking into account both the dependence on the 
output precision n and / (i.e. parameters according to a) 

c) which turns out to be (ordinary) polynomial — except for composition which is fixed- 
parameter tractable but may increase one parameter exponentially. 

These results entail a-priori judgement of whether, and on which inputs /, the algorithms 
underlying Theorems 13.31 and 13.71 may be efficient in practice; see below. And a) suggests 
concrete data structures for representing real analytic functions in, say, iRRAM as well as 
for C++ interface declarations of actual implementations of the above operators (i) to (vii). 
Concerning future work we record 

Goals 5.1 a) Investigate the complexity of division, that is the (partial) operator f \— )■ 1//. 

b) Investigate the complexity of inversion, that is the (partial) operator f \— > f ■ 

c) Generalize all above results to the multivariate case. 

Item b) may suggest a parameterization in terms of the modulus of unicity; cmp., e.g., [Ko91} 
Theorem 4.6] and |Kohl08l §16.1]. 

5.1 Concerning Practical Efficiency 

The algorithms underlying Theorem 13.31 look practical and promising to implement and eval- 
uate on. 

For instance each invocation of c) and d) can essentially double the value of K and thus also 
the running time of subsequent operations. However the same applies already to iterations of 
ordinary integer multiplication (repeated squaring) and hence seems unavoidable in the worst 
case. We expect some improvement on 'typical' cases, though, from refining the bound in 
Equation ()10p to the more general form \aj\ < A(j)/r J with A : N — > N from an appropriate 
function class [Bittl2] , 

It may be advisable to avoid in general invoking (the algorithm realizing) Theorem 13.3b ) 
whenever possible. For instance concerning the proof of Theorem 13.7b v+vi) it may be less 
elegant but more practical to handle also non-equidistant x m and different L m . To this end 
consider the following alternative approach towards identifying intervals Ik partitioning [u; v] 
and each contained within some J m : After choosing m with u G J m and m! with v G J m i, 
output I := [u,u'\ where v! := min(u,x m + 2^£) as before, but also initialize M := {m}. 
While m 7^ m! holds (otherwise we are done covering [u; v]), iteratively set u := v! and choose 
to this new u some m^M with u G J m ; again output I := [u, u'\ for u' : = min (v, x m + 2Z~) 
and let M:=MU {m}. The restriction to m M avoids possible cycles in degenerate cases 
like Xfc + 22^7 = xc + f° r some k 7^ £. On the other hand m^M with u G J m always exists: 
On the one hand we have \J m J m 5 [0; 1]; and on the other hand induction on the number of 
loop iterations shows x m + 777— < it to hold for all m G M. 

5.2 Quantitative Complexity Theory of Operators 

Polytime computability is generally considered appropriate a formalization of efficient tractabil- 
ity in practice. However asymptotic running times like O(nlogn) and 0(n 999 ), although both 
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polynomial, obviously make a considerable difference. Actually specifying the exponent of 
polynomial growth thus allows for a more precise estimate of the (range of) practicality of an 
algorithm: softly linear, quadratic, cubic etc. Such an approach seems infeasible for second- 
order polynomial time bounds, though, because they cannot naturally be ordered linearly 
with respect to asymptotic growth: 

Example 5.2 With respect to n — > oo, P(n,£) = £{£(n 2 ) ■ n) • n grows asymptotically slower 

than Q(n,£) = (£(ra 3 )) 2 -n 9 in case £(n) < 0(n( 5+v/ ^)/ 4 ) and faster otherwise. More precisely, 
fori a polynomial in n of degree d, it holds degP(n, £) = 2d 2 + d+ 1 and degQ(n,£) = 6d + 9. 

Put differently: When algorithms A and B exhibit second-order polynomial running times 
P and Q, respectively, then none is superior to the other globally; but for a given family of 
inputs of known size i, one can predict whether A or B is asymptotically preferable. 

This suggests to quantify the asymptotic growth of a second-order polynomial P(n, £) in terms 
of its degree with respect to n as a (polynomial) function of deg(^). To this end, the following 
tool may turn out as useful: 

Lemma 5.3 a) Let M.\ denote an ordinary Turing machine calculating a partial map f :C 
{0, 1}* — > {0, l}* within time < t\(n) producing outputs of length at most si(n) < t\(n); 
similarly for another machine M.2 calculating g of length at most S2(n) within time < 
t2{n). Then there is a machine calculating the composition gof within time < tz(n) : = 
ti(n) + £2(^1 (n)) of length at most s^n) := s 2 (si(n)) . 

b) Let M-l denote an oracle Turing machine calculating a partial mapping F :C 1Z — > 1Z 
within second-order time < T\ = T\{n,£) producing, for every length-monotone oracle tjj 
and inputs u £ {0, l} n , outputs of length at most Si(n,\ifj\) < Ti(n,\ip\); similarly for 
another machine calculating G within time < T2(n,£) of size at most S2(n,£). Then 
there is a machine .M3 calculating G o F within time < T3 and of size at most S3, where 

S 3 (n,£):=S 1 (n,S 2 (-,£)) and T 3 (n,£) :=f(n,l)-T 2 (T '(n, £),£), f(n,£):=T 1 (n,S 2 (;£)) 

c) Consider second- order polynomials P = P(n,£) in first- order and second-order variables n 
and£, respectively. Abbreviating d := deg(£), define the ordinary polynomial deg(P) G N[d] 
by structural induction as follows: deg(l) := ; deg(n) := 1, deg(^(P)) := d- deg(P) 7 
deg(P + Q) :=max(deg(P),deg(Q)) ; and deg(P • Q) := deg(P) + deg(Q). 

Then P(n,£) = O (n deg ( p ) {d) ) as n -> 00. Moreover deg (p(Q(n,£),£)^ = deg(P) • 

deg(Q) and deg (^P(n,Q(-,£))^j = deg(P) o deg(Q). In particular with the notation from 

b) it follows deg(5 3 ) = deg(Si) o deg(5 2 ) and deg(T) = deg(Ti) o deg{S 2 ) and deg(T 3 ) = 
deg(T) + deg(r 2 )-deg(T). 

Proof, b) When presented with a length-monotone ip : {0, 1}* — > {0, l}* of size £ = \ip\ and 
on inputs a € {0, l}" 1 , Jv(^ by hypothesis makes < T 2 (m,l) steps and produces some 

output b of length 5 2 (m, £). In the composition Adf := M.^ 2 , A4^ thus serves as a string 
function of size £' := S 2 (-,£); for which Ai± converts inputs x of length n into outputs y of 
length Si(n,£'); compare Figure 0b). This calculation of M.\ takes at most m := T(n,£') 
steps. In particular, M\ can make no more than that many oracle queries of length at 
most m, each; hence each such query, now fed to A4 2 , takes it < T2(m,£) steps to answer. 

□ 
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5.3 Optimality Questions 

The literature on TTE provides some categorical constructions of natural representations 
for certain spaces — and can prove them optimal. For instance p is known to be, up to 
computational equivalence, the only reasonable choice for the space R [Her99a]; similarly for 
C[0;1] [WeihOOl §6.1]. 

Strengthening from computability to complexity on C w ([0; 1]), the above representations 
a, /3, 7 all render common primitive operations polytime computable — and have turned out 
as mutually fully polytime equivalent. One might therefore conjecture that they are optimal in 
the sense that any second-order representation making these operations polytime computable 
is in turn polytime reducible to a,/3,j. 

However consider the following (artificial) 

Definition 5.4 A length-monotone string function if) : {0, 1}* — > {0, 1}* constitutes a 6- 
name of f G C°°[0; 1] if, for every d G N, the mappings 

w (->■ ip(0 l d 0w) and w ^ l d w) 

constitute (padded) [p^ + binary(Lip)) -names of [0; l] 2 3 (u,v) h-» MAX , u, v) and of 

[0; l] 2 3 (u,v) i—)- MAX (f(~ d \u,v), respectively. Here denotes the d-th derivative of f in 
case d > 1; and f^~ d ^ the d-fold antiderivative with f^~ d \0) = 0. 

Noting f(x) = MAX(f,x,x) and in view of Example 12 .6a ). it is then immediate that this 
second-order representation renders the very operations from Theorem 13.7b ) second-order 
polytime computable. In particular it permits to find integers Aj with \\f (j) \\ < Af, but not 
to continuously (not to mention polytime computably, and even restricted to / G C w ([0; 1])) 
deduce integers (K,A) satisfying Vj : ||/^|| < A ■ Ri ■ jl. 



References 

AbLe07. M.A. Abutheraa, D. Lester: "Computable Function Representations Using Effective Chebyshev 
Polynomial", pp. 103-109 in World Academy of Science, Engineering and Technology vol.31 (2007). 

AFL96. G. Alefeld, A. Frommer, B. Lang (Edts): "Scientific Computing and Validated Numerics'" , 
Wiley- VCH (1996). 

AnMc09. V.V. Andreev, T.H. McNicholl: "Computing Conformal Maps onto Canonical Slit Domains", 
pp. 23-34 in (A. Bauer, R. Dillhage, P. Hertling, K. Ko, and R. Rettinger, eds.) Proc. 6th Int. 
Conf. on Computability and Complexity in Analysis (CCA2009), vol.353 of Informatik Berichte 
FernUniversitat in Hagen. 

BBP97. D.H. Bailey, P.B. Borwein, S. Plouffe: "On the Rapid Computation of Various Polylogarithmic 
Constants", pp. 903-913 in Mathematics of Computation vol. 66:218 (1997). 

BCSS98. L. Blum, F. Cucker, M. Shub, S. Smale: "Complexity and Real Computation" , Springer (1998). 

BGP11. O. Bournez, D.S. Graqa, A. Pouly: "Solving Analytic Differential Equations in Polynomial Time 
over Unbounded Domains", pp. 170-181 in Proc. 36th Int. Symp. on Mathematical Foundations of 
Computer Science (MFCS'2011), Springer LNCS vol.6907. 

Bittl2. J. Bitterlich: "Data Structures and Efficient Algorithms for Power Series in Exact Real Arith- 
metic", Bachelor Thesis TU Darmstadt (2012). 

BLWW04. F. Bornemann, D. Laurie, S. Wagon, J. Waldvogel: "The SIAM 100- 
Digit Challenge: A Study in High- Accuracy Numerical Computing", SIAM (2004); 
http : //www. siam.org/books/100digitchallenge/ 

BPR06. S. Basu, R. Pollack, M.-F. Roy: "Algorithms in Real Algebraic Geometry" , Springer (2006). 

Brav05. M. Braverman: "On the Complexity of Real Functions", pp. 155-164 in Proc. 46th Annual IEEE 
Symposium on Foundations of Computer Science (FOCS 2005). 



Parameterized Uniform Complexity in Numerics 41 



BrCo06. M. Braverman, S.A. Cook: "Computing over the Reals: Foundations for Scientific Computing", 
pp.318-329 in Notices of the AMS vol.53:3 (2006). 

Biirg08. P. BuRGlSSER: "Smoothed Analysis of Condition Numbers", pp. 1-41 in Foundations of Computa- 
tional Mathematics (F. Cucker, A. Pinkus, M. Todd Edts), London Mathematical Society Lecture 
Note Series 363, Cambridge University Press (2009). 

Chen66. E.W. Cheney: " Introduction to Approximation Theory", McGraw-Hill (1966). 

DeYilO. L. Demanet, L. YinG: "On Chebyshev Interpolation of Analytic Functions", preprint (2010). 

DuYa05. Z. Du, C.K. Yap: "Uniform Complexity of Approximating Hypergeometric Functions with Absolute 
Error", pp. 246-249 in (S.I. Pae, H.-J. Park, editors) Proc. 7th Asian Sump, on Computer Math. 
(ASCM 2005). 

Eige08. A. EigenwilliG: "Real Root Isolation for Exact and Approximate Polynomials Using Descartes' 

Rule of Signs" , Disseration (2008) Universitat des Saarlandes. 
Escall. M. ESCARDO: "Algorithmic Solution of Higher- Type Equations", to appear in Journal of Logic 

Computation (2011). 

FlGr06. J. Flum, M. Grohe: "Parameterized Complexity Theory", Springer (2006). 

Frie84. H. Friedman: "The Computational Complexity of Maximization and Integration", pp. 80-98 in 
Advances in Mathematics vol.53 (1984). 

GaHol2. T. Gartner, G. Hotz: "Representation Theorems for Analytic Machines and Computability of 
Analytic Functions", pp. 65-84 in Theory of Computing Systems vol. 51:1 (2012). 

Gevrl8. M. Gevrey: "Sur la nature analytique des solutions des equations aux derivees partielles. Premier 
memoire", pp. 129-190 in Annates scientifiques de I'E.N.S., 3 e serie, tome 35 (1918). 

Grze57. A. Grzegorczyk: "On the Definitions of Computable Real Continuous Functions", pp. 61-77 in 
Fundamenta Mathematicae 44 (1957). 

Her99a. P. HertlinG: "A Real Number Structure that is Effectively Categorical", pp. 147-182 in Mathe- 
matical Logic Quarterly vol. 45:2 (1999). 

Her99b. P. HertlinG: "An Effective Riemann Mapping Theorem", pp. 225-265 in Theoretical Computer 
Science 219 (1999). 

Hert02. P. HertlinG: "Topological Complexity of Zero Finding with Algebraic Operations", pp. 912-942 in 

Journal of Complexity vol. 18:4 (2002). 
vdH*ll. J. van der Hoeven, G. Lecerf, B. Mourrain, P. Trbuchet, J. Berthomieu, D. Niang 

Diatta, A. MantzaflariS: "Mathemagix, The Quest of Modularity and Efficiency for Symbolic 

and Certified Numeric Computation", pp. 166-188 in ACM SIGSAM Communications in Computer 

Algebra vol.l77:3 (2011). 

Ho99. C.-K. Ho: "Relatively Recursive Real Numbers and Real Functions", pp. 99-120 in Theoretical 

Computer Science vol.210 (1999). 
Hotz09. G. Hotz: "On in Polynomial Time Approximable Real Numbers and Analytic Functions", pp. 155- 

164 in Informatik als Dialog zwischen Theorie und Anwendung, Vieweg+Teubner (2009). 
KaCo96. B.M. Kapron, S.A. Cook: "A New Characterization of Type-2 Feasibility", pp. 117-132 in SIAM 

Journal on Computing vol. 25:1 (1996). 
KaColO. A. Kawamura, S.A. COOK: "Complexity Theory for Operators in Analysis", pp.495-502 in Proc. 

42nd Ann. ACM Symp. on Theory of Computing (STOC 2010); 

full version in ACM Transactions in Computation Theory vol. 4:2 (2012), article 5. 
KawalO. A. Kawamura: "Lipschitz Continuous Ordinary Differential Equations arc Polynomial- Space Com- 
plete", pp. 305-332 in Computational Complexity vol. 19:2 (2010). 
KLRK98. V. Kreinovich, A. Lakeyev, J. Rohn, P. Kahl: "Computational Complexity and Feasibility of 

Data Processing and Interval Computations" , Academic Press (1998). 
Ko91. K.-I. Ko: "Computational Complexity of Real Functions" , Birkhauser (1991). 

Ko98. K.-I. Ko: "Polynomial-Time Computability in Analysis", pp.1271-1317 in (Yu. L. Ershov et al., 

Eds.) Handbook of Recursive Mathematics vol.2 (1998). 
KoFr82. K.-I. Ko, H. Friedman: "Computational Complexity of Real Functions" , pp. 323-352 in Theoretical 

Computer Science vol.20 (1982). 
Kohl96. U. Kohlenbach: "Mathematically Strong Subsystems of Analysis with Low Rate of Growth of 

Provably Recursive Functionals" , pp. 31-71 in Archive for Mathematical Logic vol.36 (1996). 
Kohl98. U. Kohlenbach: "Proof Theory and Computational Analysis", pp. 124-157 in Electronic Notes in 

Theoretical Computer Science vol.13 (1998). 
Kohl08. U. Kohlenbach: "Applied Proof Theory: Proof Interpretations and their Use in Mathematics", 

Springer Monographs in Mathematics (2008). 



42 



Akitoshi Kawamura, Norbert Th. Muller, Carsten Rosnick, Martin Ziegler 



K0RZ12. A. Kawamura, H. Ota, C. Rosnick, M. Ziegler: "Computational Complexity of Smooth Differ- 
ential Equations", pp. 578-589 in Proc. 37th Int. Symp. on Mathematical Foundations of Computer 
Science (MFCS'2012), Springer LNCS vol.7464; before presented (in Japanese) at the 10th 
EATCS/LA Workshop on Theoretical Computer Science Kyoto, Japan, January 2012. 

KoYu08. K.-I. Ko, F. Yu: "On the Complexity of Convex Hulls of Subsets of the Two-Dimensional Plane", 
pp. 121-135 in Electronic Notes in Theoretical Computer Science vol.202 (2008). 

KrMa82. G. Kreisel, A. Macintyre: "Constructive Logic versus Algebraization I", pp. 217-260 in Proc. 
L.E.J. Brouwer Centenary Symposium (Troelstra, van Dalen; Eds.), North-Holland (1982). 

KrPa02. S.G. Krantz, H.R. Parks: u A Primer of Real Analytic Functions", 2nd Edition, Birkhauser 
(2002). 

Lamb07. B. LAMBOV: "RealLib: An Efficient Implementation of Exact Real Arithmetic", pp. 81-98 in Math- 
ematical Structures in Computer Science vol. 17:1 (2007). 

LLM01. S. Labhalla, H. Lombardi, E. MOUTAI: "Espaces metriques rationnellement presentes et com- 
plexity, le cas de l'espace des fonctions reelles uniformement continues sur un intervalle compact" , 
pp. 265-332 in Theoretical Computer Science vol.250 (2001). 

Mehl76. K. Mehlhorn: "Polynomial and Abstract Subrecursive Classes", pp. 147-178 in Journal of Com- 
puter and System Sciences vol. 12:2 (1976). 

MM86. N.T. MULLER: "Subpolynomial Complexity Classes of Real Functions and Real Numbers", 
pp. 284-293 in Proc. 13th International Colloquium on Automata, Languages, and Programming 
(ICALP'86), Springer LNCS vol.226 (1986). 

Miill87. N.T. Muller: "Uniform Computational Complexity of Taylor Series", pp. 435-444 in Proc. 14th 
Int Coll. on Automata, Languages, and Programming (ICALP'87), Springer LNCS vol.267. 

MM95. N.T. Muller: "Constructive Aspects of Analytic Functions", pp. 105-114 in Proc. Workshop 
on Computability and Complexity in Analysis (CCA), InformatikBerichte FernUniversitat Hagen 
vol.190 (1995). 

MiillOl. N.T. Muller: "The iRRAM: Exact Arithmetic in C++", pp. 222-252 in Proc. 4th Int. Workshop on 
Computability and Complexity in Analysis (CCA'00), Springer LNCS vol.2064 (2001). 

MiiKolO. N.T. Muller, M. KorovinA: "Making big steps in trajectories", pp.106-119 in Proc. 7th Int. Conf. 

on Computability and Complexity in Analysis (CCA'2010), Electronic Proceedings in Theoretical 
Computer Science vol.24. 

MiiMo93. N.T. Muller, B. Moiske: "Solving Initial Value Problems in Polynomial Time", pp.283-293 in 

Proc. 22nd JAIIO-PANEL (1993). 
MiiZh08. N.T. Muller, X. Zhao: "Complexity of Operators on Compact Sets", pp. 101-119 in Proc. 4th 

Int. Conf. on Computability and Complexity in Analysis (CCA'07), vol.202 (2008). 
Neuml2. E. Neumann: "Parametrised Complexity of Functionals on Spaces of Real Functions", Bachelor's 

Thesis Darmstadt Technical University (2012). 
Oliv05. P. OlivA: "Polynomial-time Algorithms from Ineffective Proofs", pp. 128-137 in Prof. 18th IEEE 

Symp. on Logic in Computer Science (LiCS'03). 
Papa94. C.H. Papadimitriou: "Computational Complexity" , Addison- Wesley (1994). 
PERi89. M.B. Pour-El, J.I. Richards: "Computability in Analysis and Physics" , Springer (1989). 
Rett07. R. Rettinger: "Computability and Complexity Aspects of Univariate Complex Analysis" , Habili- 

tation thesis FernUniversitat Hagen (2007). 
Ret08a. R. Rettinger: "Lower Bounds on the Continuation of Holomorphic Functions", pp. 207-217 in 

Proc. 5th Int. Conf. on Computability and Complexity in Analysis (CCA 2008), Electronic Notes 

in Theoretical Computer Science vol.221. 
Ret08b. R. Rettinger: "Bloch's Constant is Computable", pp. 896-907 in Journal of Universal Computer 

Science vol.l4:6 (2008). 

Rett09. R. Rettinger: "Towards the Complexity of Riemann Mappings (Extended Abstract)", in Proc. 

6th Int. Conf. on Computability and Complexity in Analysis (CCA 2009), Dagstuhl Research Online 
Publication Server. 

Rivl74. T.J. Rivlin: "The Chebyshev Polynomials" , Wiley&Sons (1974). 

Roesll. C. Rosnick: "Approximate Real Function Maximization and Query Complexity" , Masters Thesis 

Informatik, Universitat Paderborn (2011). 
Rump04. S.M. Rump: "Computer-Assisted Proofs I", pp. 2-11 in Bulletin of the Japan Society for Industrial 

and Applied Mathematics vol. 14:3 (2004). 
Schr07. M. Schroder: "Admissible Representations of Probability Measures", pp. 61-78 in Electronic Notes 

in Theoretical Computer Science vol.167 (2007). 



Parameterized Uniform Complexity in Numerics 43 



SGV94. A. Schonhage, A.F.W. Grotefeld, E. Vetter: "Fast Algorithms — A Multitape Turing Ma- 
chine Implementation" , BI Wissenschafts-Verlag (1994). 

Sharl2. S.P. Shary during 15th GAMM-IMACS International Symposium on Scientific Computing, Com- 
puter Arithmetics and Verified Numerics (SCAN'2012) in discussion with V. Kreinovich. 

Smal98. S. Smale: "Mathematical Problems for the Next Century", pp. 7-15 in Math. Intelligencer vol. 20:2 
(1998). 

TeZilO. K. Tent, M. Ziegler: "Computable Functions of Reals", pp.43-66 in M"unster Journal of Math- 
ematics vol.3 (2010). 

Turi37. Turing, A.M.: "On Computable Numbers, with an Application to the Entscheidungsproblem. A 

correction", pp.544-546 in Proc. London Math. Soc. vol.43(2) (1937). 
TWW88. J.F. Traub, G.W. Wasilkowski, H. Wozniakowski: "Information-Based Complexity, Academic 

Press (1988). 

vdHo08. J. VAN der Hoeven: "Fast Composition of Numeric Power Series", Universite Paris-Sud Technical 
Report 2008-09. 

vdHo07. J. VAN der Hoeven: "On Effective Analytic Continuation", pp. 111-175 in Mathematics in Com- 
puter Science vol. 1:1 (2007) 

vdHo05. J. VAN der Hoeven: "Effective Analytic Functions", pp.433-449 in Journal of Symbolic Computa- 
tion vol.39 (2005). 

WeihOO. K. Weihrauch: "Computable Analysis" , Springer (2000). 

Weih03. K. Weihrauch: "Computational Complexity on Computable Metric Spaces", pp. 3-21 in Mathe- 
matical Logic Quarterly vol. 49:1 (2003). 

Yap04. C.-K. Yap: "On Guaranteed Accuracy Computation", pp. 322-373 in Geometric Computation (Falai 
Chen and Dongming Wang Edts), World Scientific Publishing (2004). 

ZhWeOl. X. Zheng, K. Weihrauch: "The Arithmetical Hierarchy of Real Numbers", pp. 51-65 in Mathe- 
matical Logic Quarterly vol.47 (2001). 

Zieg04. M. Ziegler: "Computable Operators on Regular Sets" , pp. 392-404 in Mathematical Logic Quarterly 
vol.50 (2004). 

Zieg07. M. Ziegler: "Revising Type-2 Computation and Degrees of Discontinuity" , pp. 255-274 in Proc. 

3rd International Conference on Computability and Complexity in Analysis (CCA'06), Electronic 

Notes in Theoretical Computer Science vol.167 (2007). 
Ziegl2. M. Ziegler: "Real Computation with Least Discrete Advice: A Complexity Theory of Nonuniform 

Computability", pp. 1108-1139 in Annals of Pure and Applied Logic vol. 163:8 (2012). 



